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OOPPSS2 — We Goofed 


Much to our chagrin, the last GAO 
Review contained some obvious mis- 
takes. Inadvertent placement of several 
titles and paragraphs, combined with 
typographical errors and missing pages 
in certain copies, made the winter 
1983 issue one of our “‘liveliest’’ to 
date. Because of these goofs—described 
below— many of our readers responded 
with excellent constructive criticism 
(i.e., proofreading help). In fact, our 
embarrassment had a positive result. 
We learned that many people read the 
Review closely as soon as they receive 
their copies! 


Apologies All Around 


The worst-offending errors are on 
page 53, where Dexter Peach's title as 
director of the Resources, Community 
and Economic Development Division 
was replaced with that of Assistant 
Comptroller General, and page 61, where 
Bob Hanlon, regional manager in Denver, 
and several staff members were shown 
as moved to Detroit. Next in line was 


page 52, whereparagraphs describing 
top-level staff changes are printed 
twice, followed closely (actually pre- 
ceded) by page 50 where the Far East 
Branch is mistakenly listed as assist- 
ing Paul Math in his article on shad- 
owing. Add to these errors a liberal, if 
not ironic, sprinkling of typos, espe- 
cially in Tom Pastore’s article (pp. 24- 
27) on the advantage of having basic 
typing skills. 


The Editor Responds 


When informed of the errors, Editor 
John Heller (recently retired from GAO) 
said;’Good grief!" He added, however, 
“| always knew GAO Review readers 
could respond to a challenge. | am 
especially pleased to see that, in my 
absence, the Review has taken some 
steps to test its audience. Thanks to 
each of you who alerted our editorial 
staff about this issue’s goofs.” 

Heller then described his perception 
of the major errors from his vantage 
point on the 5th floor of the Metro 


Errata 


Building, overlooking GAO. ‘From 
where | sit, listing Dexter Peach as 
Assistant CG may be the publishing 
coup of the year. He certainly has the 
qualifications to fill the job! If wisdom 
prevails, perhaps he may have that 
chance. In fact, our readers can say 
they saw it first in the GAO Review!" 


‘My sources report that Dexter and 
the others affected by the mistakes 
accepted our apologies with good humor. 
| certainly hope so, because our rota- 
ting Bob Hanlon to Detroit was probably 
not in his plans!” 


Ina more serious tone, Heller added 
that the publishing checks on our last 
issue were obviously not up to par. We 
agree. The Review staff has developed 
additional quality controls and will be 
applying them from now on. Again, 
our apologies to those affected by the 
mistakes in the winter 1983 Review 
and thanks to our readers, article and 
feature writers, and unit liaisons for 
your support. 


The acknowledgmentof contributors to 
the Far East article which appears on 
page 50, column 3, should have preceded 
the article, “At Home and Abroad in 
Paradise: GAO's Far East Branch,’’ 
page 32. 


Paragraphs describing top-level staff 
changes are printed twice. 


The title “GAO's Assistant Comptrol- 
lers General’ should have been positioned 
under the pictures of Henry Eschwege 
and Francis X. Fee. J. Dexter Peach's 
title is Director, Resources, Community 
and Economic Development Division." 


The heading ‘‘Detroit’’ printed in 
column 3 is misplaced. It should have 
appeared on page 62, preceding the 
name of William Laurie. 
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Accounting Update 


GAO To Inventory 
Statutory Audit 
Requirements 


GAO is undertaking a project to 
identify the maze of audit require- 
ments found in the nearly 1,000 Fed- 
eral programs, projects, services, 
and activities which provide assis- 
tance or benefits to the public. GAO 
studies have shown that these re- 
quirements have led to inconsisten- 
cies, gaps, and duplications in audit 
coverage. The project will result ina 
comprehensive inventory and analy- 
sis of the statutory audit provisions 
pertaining to Federal financial as- 
sistance programs. 

The project will help GAO further 
develop and advance the concept of 
the single entity audit, which pro- 
vides for a financial and compliance 
audit (including a comprehensive re- 
view of internal controls) of a single 
entity or organization rather than 
detailed audits for each separate 
program involving financial assis- 
tance. The concept provides an im- 
proved audit base for performing ad- 
ditional selective audits for detailed 
compliance issues as well as to de- 
termine economy and efficiency or 
program results. 

Identifying Federal audit require- 
ments will assist GAO as it con- 
siders recommending amendments 
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to existing legislation, including the 
possibility of proposing some form 
of ‘cross-cutting’ single entity 
audit legislation for all Federal 
assistance programs. 


New Types of Reports on 
Financial Statements 


Opinions and disclaimers of opin- 
ion are not the only types of reports 
GAO issues on government corpora- 
tions’ financial statements. GAO 
now also issues reports on financial 
statement compilations and reviews. 

In a compilation, the accountant 
presents information in financial 
statement form which represents 
management without undertaking 
to express any assurance on the 
statements. The accountant does 
not audit the statements and, ac- 
cordingly, does not express an opin- 
ion or any other form of assurance 
on them. 

In a review, the accountant per- 
forms inquiry and analytical pro- 
cedures that provide a reasonable 
basis for expressing certain limited 
assurances. A review is more lim- 
ited in scope than an audit, so it 
does not provide a basis for expres- 
sion of an opinion regarding the fi- 
nancial statements taken as a whole. 
The American Institute of Certified 
Public Accountants (AICPA) has 
issued several Statements on Stan- 
dards for Accounting and Review 
Services. 


GAO has recently completed a 
compilation of the financial state- 
ments of the United States Railway 
Association (AFMD-82-69) and a 
review of the financial statements 
of the Commodity Credit Corpora- 
tion (CED-81-137). 


Recent Guidance Issued 
on Personal Financial 
Statements 


The AICPA has issued two pro- 
nouncements on personal financial 
statements. “Accounting and Finan- 
cial Reporting for Personal Finan- 
cial Statements,” AICPA Statement 
of Position 82-1, was issued on Oc- 
tober 1, 1982. This statement deals 
with preparing and presenting finan- 
cial statements of individuals or 
groups of related individuals 
(families). Personal financial 
statements assist individuals to for- 
mally organize and plan their finan- 
cial affairs in general or may be 
used for specific purposes, such as 
obtaining credit, income tax plan- 
ning, or retirement planning. 

“Personal Financial Statements— 
Compilation, Review, and Audit,” a 
proposed guide issued on November 
1, 1982, discusses the scope of work 
and form of report for an audit, re- 
view, or compilation of personal 
financial statements. 

For copies, or for further informa- 
tion, contact the AICPA, 1211 
Avenue of the Americas, New York, 
NY 10036. 


Governmental Accounting 
Standards Board Update 


The Financial Accounting Foun- 
dation reached agreement in De- 
cember 1982 with representatives of 
State and local governmental orga- 
nizations and the public accounting 
profession regarding the establish- 
ment of a Governmental Accounting 
Standards Board. The proposed 
Board, which would establish 
accounting and reporting require- 
ments for State and local govern- 
ment, would be under the Founda- 
tion in the same respect as the 
existing Financial Accounting Stan- 
dards Board, which establishes ac- 
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counting and reporting 
ments for business. 

In addition, a governmental ad- 
visory and oversight body to be 
known as the Governmental Ac- 
counting Standards Advisory Coun- 
cil would be established under the 
Foundation. Approximately 20 orga- 
nizations, including GAO, would be 
invited to nominate Council 
members. 


require- 


GAO’s Work on Tax 
Administration 
Activities During 1981 


GAO has been auditing and report- 
ing on Federal tax administration ac- 
tivities, particularly at IRS, for the 
past decade. Prior to October 1977, 
GAO conducted its audits as an 
agent of the Joint Committee on Tax- 
ation because the executive branch 
did not recognize GAO’s authority to 
independently access tax records for 
audit purposes. In October 1977, the 
Congress passed Public Law 95-125, 
amending the Accounting and Audit- 
ing Act of 1950 to specifically give 
GAO independent access to tax 
records to audit tax administration 
activities. 

With the expanded access, the 
Congress required GAO to report an- 
nually to the tax writing and Govern- 
ment operations committees on the 
results of GAO’s work in the tax area. 
The first four annual reports were 
issued, with limited distribution, as 
letters to the House Committee on 
Ways and Means, the Senate Com- 
mittee on Finance, the Joint Commit- 
tee on Taxation, the Senate Commit- 
tee on Governmental Affairs, and the 
House Committee on Government 
Operations. Due to the popularity 
and usefulness of past reports, the 
report on GAO’s 1981 work was 
issued as a blue-cover report and 
was more widely distributed than in 
the past. The report, which consists 
of eight enclosures, summarizes the 
results of GAO’s work during 1981, 
including the reports issued and 
testimonies delivered. It also sum- 
marizes the actions taken during the 
year on GAO's recommendations by 
the Congress and IRS. In addition, 
the report inventories open recom- 
mendations to the Congress from 
reports issued before 1981. (See 
GAO/GGD-82-82, July 22, 1982.) 


Although the annual tax adminis- 
tration report is compiled primarily to 
meet the Congress’ legislative man- 
date, it has also been useful for plan- 
ning and managing GAO’s work in 
the tax area. For example, it has 
facilitated following up GAO recom- 
mendations and promoting GAO’s 
solutions for improving administra- 
tion of the Federal tax laws. In this 
regard, the tax writing committees 
used the annual report in incor- 
porating several GAO recommenda- 
tions into the recently enacted Tax 
Equity and Fiscal Responsibility Act 
of 1982. For more information, con- 
tact Johnny Finch, General Govern- 
ment Division, (202) 275-6407. 


Review Article on 
Silver Recovery Gets 
Recycled 


The GAO Review reaches several 
thousand academic, business, and 
government readers in the United 
States and other countries, but we 
seldom receive their comments by 
return mail. Thus, the editorial staff 
was recently pleased to receive a 
copy of a letter to one of our 
authors, Everette B. Orr, a senior 
evaluator with the Procurement, 
Logistics and Readiness Division, 
from Dr. Philip C. Kolin, Associate 
Professor of English at the Univer- 
sity of Southern Mississippi. Dr. 
Kolin teaches technical writing and 
was requesting to use Orr’s article 
as a model of effective writing. Dr. 
Kolin saw the article, “A Silver Mine 
from Photographic Wastes,” in the 
Winter 1982 Review and felt that it 
was a model proposal in article for- 
mat. He noted, “The article contains 
the main parts of any good pro- 
posal—identification of a problem, 
analysis of costs, and final justifica- 
tion for adopting the methods out- 


lined in the proposal.” Dr. Kolin also 
expressed his interest in receiving 
any feasibility studies used in GAO. 

The Review congratulates author 
Orr and notes that the GAO reports 
on which his article was based’ are 
used as case-study material in 
GAO’s entry-level training course. If 
you have additional ideas for Dr. 
Kolin to show his students ‘‘how to 
write on the job,” call Orr at (202) 
275-6547. If you want to begin a GAO 
Review article of your own, contact 
your unit liaison or any member of 
our editorial staff. 


Joint Financial 
Management 
Improvement 
Program’s 1982 
Accomplishments 


Under the Joint Financial Man- 
agement Improvement Program 
(JFMIP), the Comptroller General, 
the Secretary of the Treasury, the 
Director of the Office of Manage- 
ment and Budget, and the Director 
of the Office of Personnel Manage- 
ment are charged by the Budget and 
Accounting Act of 1950 with improv- 
ing financial management practices 
throughout the Federal Govern- 
ment. JFMIP’s executive director 
Susumu Uyeda recently published 
the program’s major accomplish- 
ments during fiscal year 1982 in 
JFMIP’s News Bulletin. (As a con- 
tribution to paperwork reduction, 
JFMIP will not be issuing an annual 
report.) 





\Additional Precious Metals Can Be 
Recovered” (LCD-77-228, Dec. 28, 1977); 
“Civil Agencies Should Save Millions by 
Recovering Silver from Photographic 
Wastes” (PLRD-81-48, July 31, 1981). 
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The Review would like to highlight 
some of the ways JFMIP con- 
tributed to improved financial man- 
agement in 1982. According to Mr. 
Uyeda, the JFMIP 


e acted as a mechanism to coordi- 
nate proposed rules and regulations 
(e.g., OMB Circular A-123, Internal 
Control Systems) before issuance 
by the central financial manage- 
ment agencies, 


e established an intergovernmental 
committee and made (and con- 
tinues to make) recommendations 
as to the resolution of major prob- 
lems concerning the implementa- 
tion of single audit, 

e conducted a study for the Office 
of Management and Budget on the 
feasibility of tracking subgrants and 
pass-through grants as part of the 
Federal Assistance Award Data 
System, 

e performed a study, at the request 
of the Department of Defense, on 
reporting of overobligations and 
overexpenditures of funds under 
section 3679 of the Revised 
Statutes, 

e assisted the Department of Com- 


merce in developing a productivity 


measurement system in finance and 
accounting operations, 

e undertook special projects that 
produced numerous documents, in- 
cluding Financial Handbook for 
Nonfinancial Executives in the 
Federal Government, Do It Your- 
self—Compare and Improve Your 
Payroll System, Measuring Produc- 
tivity in Accounting and Financial 
Offices, Do It Yourself—Compare 
and Improve Your Property System, 
Property Management Evaluation 
Guide for Federal Agencies, and Bar 
Code Technology—A Means To Im- 
prove Operational Efficiency and In- 
ternal Control, 

® conducted a series of workshops 
on productivity improvement in co- 
sponsorship with a number of Fed- 
eral Executive Boards, 

e issued quarterly News Bulletins 
reporting on newsworthy items and 
new and interesting techniques in fi- 
nancial management, 

® sponsored two annual conferen- 
ces, the last in March 1982 with the 
theme, ‘‘The Lean Budget—A Chal- 
lenge to Financial Managers,” and 
e made over 20 visits to depart- 
ments and agencies to review their 
financial management improvement 
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programs and to share new tech- 
niques and experiences. 


JFMIP is presently undertaking 
special projects on cash manage- 
ment of grant funds by State govern- 
ments and the use of statistical 
sampling in finance and accounting 
operations. 

If you have questions about 
JFMIP or ideas on how the program 
can provide better service to the 
financial management community, 
call (202) 376-5415. 


GAO’s 1982 Annual 
Report — Volumes I 
and Il 


For fiscal year 1982, GAO is ex- 
panding its annual report into two 
volumes. The first volume highlights 
a few of GAO’s efforts and accom- 
plishments; the second volume is 
similar to previous annual reports 
and contains detailed information 
on fiscal year 1982 activities, 
legislative recommendations, finan- 
cial and other benefits of GAO’s 
work, and titles of published 
reports. 





GAO Annual Report 1982/Volume I! 
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Volume | is intended to be a 
short, highly readable report on 
what GAO has done to assist the 
Congress in its decisionmaking and 
oversight roles. Comptroller General 
Bowsher selected nine prominent 
issues addressed by GAO—defense, 
entitlements, taxes, financial 
management, economic policy, pub- 
lic facilities, nuclear energy, new 
Federalism, and program evalua- 
tion—and asked GAO’s divisions to 
write about the issues’ importance 
and GAO’s most significant contrib- 
ution in the past fiscal year. 
Roughly 20 pages long, Volume | ex- 
tensively uses pictures and other 
graphic presentations. 

Three staff members were as- 
signed to put Volume | _ together. 
Bob Levin of the Resources, Com- 
munity and Economic Development 
Division coordinated the overall 
project and wrote part of the report. 
Carol Crowder, an editor in the Ac- 
counting and Financial Manage- 
ment Division, helped to refine the 
text. Ken Psira of the Office of Ad- 
ministrative and Publishing Ser- 
vices designed the document and 
its graphics and prepared the report 
for printing. 

Volume ll is intended to be a legal 
and historical record of GAO’s work. 
Most of its sections are required for 
inclusion by U.S.C. 31, Chapter 22. 
These requirements were specified 
in Comprehensive Audit Memoran- 
dum No. 4 during August 1982, and 
staff members from many GAO 
units provided information during 
the fall. Major chapters were 
organized by Bob Jurek and Cliff 
Fowler, Office of Policy, and Marge 
Miller, Office of Congressional Rela- 
tions. Ed Sawyer of the Office of In- 
formation Systems and Services co- 
ordinated input in the key appen- 
dices, and Sharon Connolly and Ken 
Psira handled editing and graphics, 
respectively. 

During the development of both 
volumes, the Assistant Comptroller 
General for Policy, John Heller, 
relayed some interesting history 
about GAO's annual reports. The 
two-volume format has been used 
before—in 1970. Our first annual 
report was published in 1922; it was 
16 pages long. During World War Il, 
when printing supplies and labor 
were in short supply, the 1942 an- 
nual report was typed with carbon 
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copies. And 1978 was the year that a 


section listing office and division 


activities was revised into an appen- 
dix describing the current organiza- 
tional units in GAO. Copies of 
GAO’s annual reports from 
1978-1982 are available in Room 
1518, or by calling (202) 275-6241. 


The Civil Rights Report 
and the Congressional 
Staff Journal 


“From Our Briefcase” scans nu- 
merous publications for items of in- 
terest to Review readers. Here are 
two that can provide useful informa- 
tion to evaluators who work on per- 
sonnel issues and to staff who are 
interested in activities of Congress. 

GAO’s Civil Rights Office pub- 
lished its second issue of the Civil 
Rights Report in July 1982. It con- 
tained updates on GAO’s Hispanic, 
Handicapped, and Federal Women’s 
programs, as well as statistics on 
the results of competitive selection 
during fiscal year 1981. It also sum- 
marized career development and 
training programs at headquarters 
and regional offices, recent ac- 
tivities of various GAO advisory 
councils, and current legal issues in 
Federal equal employment oppor- 
tunity (EEO). 

Editor Pat McLoughlin noted that 
GAO’s commitment to EEO is as 
strong as ever, and she cited a na- 
tional poll showing popular support 
for affirmative action. In that recent 
Harris survey, 75 percent of 1256 
adults polled said it was ‘‘only fair” 
to establish special programs to 
make sure women and minorities 
are given equal opportunity; 60 per- 
cent rejected the idea that there 
should be no special consideration 
for minorities and women; 54 per- 
cent disagreed that affirmative ac- 
tion programs will result in reverse 
discrimination against white males. 
Call the Civil Rights Office at (202) 
275-6388 if you missed your copies 
of the Civil Rights Report. 

The Congressional Staff Journal 
is published for the U.S. Senate by 
the Committee on Rules and Admin- 
istration, Charles McC. Mathias, Jr., 
Md., Chairman. The Journal con- 
tains both special interest articles 
and regular features on topics such 
as court cases of interest to the 


Congress, publications worthy of 
consideration by congressional 
aides, and upcoming Hill events. 
The November/December 1982 issue 
included detailed coverage on the 
controversial new Hart Office 
Building and a listing of Congres- 
sional Research Service (CRS) 
seminars on public policy issues. 
The “Timely and Topical’ section 
listed two GAO reports, in addition 
to several from our sister agencies, 
the CRS, Congressional Budget Of- 
fice, and Office of Technology 
Assessment. 

Journal staff member Frank 
Keenan gave the GAO reports the 
following reviews: 


Strengthening Transportation- 
Policy Development and Imple- 
mentation (GAO/CED-82-102, Sep- 
tember 1982). 


... This report sets forth GAO’s 
criteria for an effective (transporta- 
tion policy development) system... 
Though GAO urges adoption of such 
a system, backed by designation of 
a unit responsible for operating it, 
DOT says recent organizational 
changes will accomplish the same 
ends. GAO says, in effect: OKAY, 
but make sure you concentrate on 
long-term policy. 


Lessons Learned From Past 
Block Grants: Implications for 
Congressional Oversight 
(GAO/IPE-82-8, September 1982). 


The short answer which emerges 
from this valuable report is, ‘Not 
much!’...GAO seems to be ask- 
ing—very discreetly and politely— 
just how Congress intends to over- 
see block grant programs to guide 
future funding and policymaking 
when the data and the evaluations it 
will be getting are likely to be con- 
siderably less than the inadequate 
supply from earlier block grants. 


For more information about the 


Congressional Staff Journal, call 
(202) 224-9078. 
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On Location 


GAO Staff Changes 


In November 1982, Comptroller 
General Bowsher established a new 
Office of Quality Assurance and 
named the first assistant regional 
manager for operations. In addition, 
the Resources, Community and Eco- 
nomic Development Division (RCED) 
became the first GAO unit to have 
both a deputy director for opera- 
tions and a deputy director for plan- 
ning and reporting. 

The Office of Quality Assurance 
will provide advice and guidance to 
the Office of the Comptroller Gen- 
eral to help assure that GAO’s work 
and reporting are as relevant and 
useful as possible. Ira Goldstein has 
been named director of the office. 
(Mr. Goldstein’s picture and bio- 
graphy appeared in the Summer 
1982 issue of the Review.) At GAO, 
Mr. Goldstein has worked with 
Assistant Comptroller General 
Harry Havens in the area of block 
grants and recently chaired the 
Reports Task Force. 

See this issue’s feature, “GAO 
Staff Changes,” for more news. 


Regional Office 
Administrative 
Officers Confer 


Administrative officers from 
GAO’s 15 regional offices met in 
Washington, D.C., in November 
1982. Their goal was to identify and 
work out administrative problems 
that are common to all the regional 
offices and to achieve greater effec- 
tiveness in carrying out the ad- 
ministrative function. 

The AOs’ first meeting, held in 
San Francisco in 1975, was ar- 
ranged by Walter H. Henson, then 
deputy director for Field Operations 
Division and currently regional 
manager in Seattle. Since that time, 
the AOs have met in Washington, 
D.C., so that various GAO staff of- 
fices, such as Personnel and Gen- 
eral Services and Controller, could 
attend. Their participation is espe- 
cially important, according to con- 
ference coordinator LaDonna 
Rodock, because it not only helps to 
solve administrative problems in the 





regional offices but also allows the 
AOs to be brought up to date on new 
GAO policies and procedures affec- 
ting administrative operations. 

The AOs faced a full agenda anda 
rigorous schedule at the their No- 
vember meeting. One of the most 
important topics was the effect of 
“EWS”—electronic workstations— 
on the regional administrative 
staffs. The AOs shared ideas on im- 
proving the quality of EWS training 
provided to users and making the 
most effective use of the equip- 
ment. Ms. Rodock said a wealth of 
information was shared, and she 
noted that, after these conferences, 
everyone returns home exhausted, 
but reinforced and prepared to per- 
form more effectively. 

Administrative officers attending 
included Eloise L. Robinson, Atlan- 
ta; Kathleen M. Sheehan, Boston; 
Lela M. Mitchell, Chicago; Carole L. 
Roby, Cincinnati; Christine M. 
Nicoloff, Dallas; James L. Pendell, 
Denver; Adrian V. Tokay, Detroit; 
Loren D. Silvey, Kansas City; Helen 
M. Figlio, Los Angeles; Helen Kaiatt, 
New York; Selmer W. Garland, Nor- 
folk; Marilyn R. Fisher, Philadelphia; 
Teresita C. Nolasco, San Francisco; 
Vickye J. Bell, Seattle; Elizabeth S. 
Chaszar, Washington; LaDonna A. 
Rodock and Patricia C. Graves, Of- 
fice of the Assistant Comptroller 
General for Operations. 


Comptroller General 
Returns from 
International Tour 


In early November 1982, Comp- 
troller General Bowsher and Interna- 
tional Division (ID) director Frank 
Conahan returned from a 10-day 
tour of ID’s European Branch, 
meetings with the Comptroller 
General’s English and German 
counterparts, and firsthand obser- 
vations of many activities reviewed 
by ID staff overseas. Mr. Bowsher 
participated in a number of brief- 
ings and social events at GAO’s 
Frankfurt office, including the 
branch’s awards ceremony. He also 
received briefings from GAO staff 
working in London and Germany. 
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During his tour of Europe, Comptroller General Bowsher visited GAO’s European Branch and made presentations for the branch's 
awards ceremony. Here, budget and travel assistant Louise Markray receives a Certificate of Merit from International Division director 


Frank Conahan (I) and Mr. Bowsher. 


In London, Mr. Bowsher met with 
Gordon Downey, Auditor General 
and Comptroller of the United 
Kingdom, as well as with other of- 
ficials. In Frankfurt, the Comptroller 
General met with Karl Wittrock, 
President of the German Federal 
Court of Audit. Mr. Bowsher also 
visited sites of U.S. military opera- 
tions in Germany and briefings on 
State Department operations in the 
U.S. embassies in London and 
Bonn. 

Mr. Bowsher concluded his visit 
to Europe with a speech before a 
joint meeting of the Association of 
Government Accountants (AGA) and 
the American Society of Military 
Comptrollers, on the challenges fac- 
ing Government financial managers. 


Ed. note: A related speech by Mr. 
Bowsher to the AGA Professional 
Development Conference in Denver 
in June 1982 entitled ‘Wanted: Com- 
mitment and Leadership—The Chal- 
lenge of the Eighties” as well as a 
question-and-answer period, is now 
available on videotape from the 
AGA National Office, (703) 684-6937. 


GAO Reports Task 
Force Issues 
Recommendations 


The Reports Task Force’s report 
on the quality, timeliness, and com- 
munication of GAO’s work was re- 
leased in November 1982, with 
“striving for excellence” as_ its 
overall theme. Comptroller General 
Bowsher established the task force 
in April 1982 to find ways to com- 
press the time between completing 
an audit and sending the report 
draft to final processing. He later 
asked the task force to expand its 
work to examine report timeliness 
and the related issues of product 
quality, content, and productivity. 
The November report includes four 
recurring themes: 


Product quality should be ex- 
emplary. GAO is doing many things 
well, in the view of both internal and 
external sources. Too little of GAO’s 
work, however, is exemplary, and 
too large a proportion fails to meet 
GAO's standards for acceptability. 
GAO should strive to be much more 
than acceptable. 


Highly skilled staff members are 
required to produce excellent prod- 
ucts. In the 1980's, evaluating 
Government programs requires 
Staff to have a set of basic quan- 
titative, design, and analytic skills, 
as well as a familiarity with ADP and 
minimum skills in writing and basic 
GAO audit techniques. GAO’s staff 
needs the right mixture if GAO is to 
produce excellent results. 

Management must provide the 
tools and incentives. The emphasis 
should be on procedures which 
build-in the assurance of quality 
products rather than trying to iden- 
tify and resolve problems after the 
fact. Management must provide the 
training, guidance, and incentives 
that will foster excellence. 

We must communicate well. The 
results of GAO’s work must be 
presented in an excellent manner if 
they are to realize their full poten- 
tial. 

Separate chapters of the task 
force’s report focus on quality, time- 
liness, and communications and 
identify shortcomings, diagnose 
underlying causes, and recommend 
corrective actions. A final chapter 
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On Location 





about the time needed to complete 
them, particularly when they had to 
review many agencies and visit 
multiple locations. in one instance, a 
dision estimated It would take 2 
weeks to go from audit work 
completed to first product delivered, 
another 2 weeks to get the report sent 
to final processing, 2 more to get 
report issued, and 2 to get the 
assignment completed. “Audit work 
" to “first product delivered 


problerns, but 
causes; staff had to stop drafting and 
Perform additional audit work to 
Produce @ convincing first draft; and 
sometimes staff 


actually took 18 weeks, and It took an 
additional 6 months to get the report 
Issued 


Understaffing By Regions and Other Staff 
Problems 


The inability to assign sufficient 
regional office personnel to a job 
Promptly, and the loss of key 
personnel to a job for various reasons. 
frequently led to job overruns. In more 
than a third of the jobs reviewed, the 
task force saw assignments where 
unavailability of staff caused regional 
offices to delay beginning the 
assignment (or to understaff it); and 
Could Be To Take instances where key staff members on 

Given the complexity of some the assignment became ill, were 
assignments we reviewed, the staff who Promoted into another division, or left 


latter would indicate an “| can make up 
the difference” philosophy which is not 
bore out later in the job by actual 
performance.) 


Authorized Time Understates Tune Job 


Certainly not predictable on a case-by 
case basis, are common but generally 
unanticipated occurrences. 


Untoresesabie In Work Scope 
Almost a third of the jobs reviewed 
were affected by unforeseen increases 
In work scope. Sometimes this 
occurred when the requestor of the 
desired additional information 
In other instances, an increase in 
scope was needed when late 
developments affected an almost 
completed review or report 


‘Multiple Organization Invotvement 

In over @ quarter of the jobs 
reviewed, the involvement of more 
than one region, division, or agency 


difficulty pulling together summaries 
fromm several regional offices and/or 
coordinating work among several GAO 
divisions. A regression analysis 
performed by the task force showed 
that an average of 9 days would be 
added to report processing for each 
agency involved, 6.4 days for each 
region involved, and 17.3 days if two or 
more divisions were involved 


Problems Obtaining Data From Agencies 
GAO had problems obtaining data 
from agencies in nearly 20 percent of 
the jobs reviewed 
delays were generally not outnght 
denials of access to records, they did 
delay assignments. Thus. one agency 
required us to supply our questions in 
wnitten form, to which it provided 
wnitten responses, another withheld 
information (temporanty) due to 
business confidentiality. and one 
military service refused to cooperate 
with GAO until the Office of the 
Secretary of Defense required 
cooperation In some instances. 
demand letters from the Acting 
Comptroller General were required to 
obtain the data 


Ineuffictent Front End 

Insufficient front end planning was a 
problem frequently identified by the 
task force About one in seven of the 
long jobs we reviewed had planning 
deficiencies which ultimately affected 
job timeliness Seven of nine division 
directors and most regional managers 
said this was a problem 


Lack of Guidelines and Control 
In speaking with division directors 


planned some jobs seemed unrealistic 


the agency. The latter problems, while 


and other GAO personnel, we 
concluded that the lack of GAOwde 
quidelines about how long jobs should 
take hampers efforts to control 
tmeliness. In addition, two systems 
with great potential for controlling 
turmeliness — AMPS and PPMA — are 
not well integrated They have other 
problems as well 

AMPS does not track multiple 
products within an assignment, so it 1s 
Not possible to tell whether each 
product of a multiple product 
assignment 1s meeting its milestones 
In addition, some jobs with multiple 
products appear to take inordinate 
amounts of ume when, in fact. each 


Product was completed within a 
reasonable umeframe 

AMPS also cannot adequately track 
assignments in a manner that permits 
compansons among divisions because 





of ambiguities in the definitions for 








mulestone 5. Audit Work Completed 
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and milestone 6, First Product to the sible manager in 
Delivered Washington, if a field office is drafting 





Under the AMPS User's Manual 
definition, “audit work completed” is 
the date when, in the judgment of the 
audit manager or team leader. the 

predominant effort’ ceases to be 
detailed audit work and becomes 
‘external report preparation. in most 
cases, this would be when the last 
Participating organization submits its 
draft product 

There are three possibilities listed in 


the Project 
the draft report to the next level of 


review 
The ambiguities in milestones 5 and 
when one 























A two page spread taken from the GAO Task Force Report. 


on productivity proposes that GAO 
look at its productivity in terms of 
efficiency (the traditional input/ out- 
put measure), quality, and time- 
liness. After a comment period, the 
report and staff comments will be 
transmitted to Mr. Bowsher for his 
consideration and action. 

The task force decided to try out 
several of its own recommendations 
about communicating better, includ- 
ing making writer/editors and 
graphic designers integral members 
of the report preparation team. The 
report itself features a simple cover, 
a three-column typeset format, and 
the extensive use of graphics. 

We hope to feature a more de- 
tailed article on the task force’s 
work in a future issue of the Review. 
In the interim, readers who have 
comments or suggestions on the 
task force report may contact task 
force director Ira Goldstein on (202) 
275-4022. 


Office of Foreign 
Visitors Hosts Many 
International Guests 


Many GAO employees are un- 
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aware of the services provided by 
the Office of Foreign Visitor and In- 
ternational Audit Organization Li- 
aison (OFVIAOL). During fiscal year 
1982, the staff hosted nearly 260 
visitors from approximately 35 dif- 
ferent countries, including Canada, 
Australia, Japan, People’s Republic 
of China, Sri Lanka, Nigeria, and 
Sweden. Visitors may contact GAO 
through their embassies or United 
Nations-sponsored educational pro- 
grams to plan their visit. 

The guests range from graduate 
students at foreign universities to 
high-ranking audit officials, mem- 
bers of parliaments, or even foreign 
ambassadors to this country. They 
all have in common an interest in 
GAO's work and how it may apply to 
theirs. 


The OFVIAOL coordinates with 


GAO divisions, offices, and regional 
offices to contact knowledgeable 


people to brief visitors on their 
areas of interest. GAO staff 
members in financial management, 
budgeting, program results audit- 
ing, personnel, and military or fraud 
issue areas are often called upon to 
discuss their work. 


The office is also responsible for 
developing the /nternational Journal 
of Government Auditing and the 
GAO Review, and for coordinating 
input on the GAO Annual Report. To 
complement GAO’s international 
auditing role, OFVIAOL runs the an- 
nual 3-month International Auditor 
Fellowship Program to train audit 
executives from other countries in 
many of GAO’s procedures for effi- 
ciency, economy, and effectiveness 
work. OFVIAOL director Elaine Orr 
and Assistant Comptroller General 
for Policy John Heller represent 
GAO in several international 
organizations. The most prominent 
of these is the International 
Organization of Supreme Audit In- 
stitutions, whose triennial con- 
ference is being held in Manila in 
April 1983. If you would like to 
become more involved with hosting 
international guests, call Alberta 
Tropf, OFVIAOL administrative 
assistant, at (202) 275-4707. Without 
division and office assistance, this 
work cannot be accomplished effec- 
tively. 





Manager’s Corner 


This issue of ‘‘Manager’s Corner” 
addresses the introduction of new 
technology to the workplace. The 
subject is especially timely, since 
electronic workstations are now be- 
ing introduced at GAO and will 
cause changes in how we organize 
and do our work. 

Members of the Senior Executive 
Service have summarized several of 
the articles in the bibliography on 
new technology. Their comments 
follow. Also included in this issue is 
a bibliography of general interest to 
managers. 

Please call Kathy Karlson at (202) 
272-3475 if you have any question 
about or suggestions for “Manager’s 
Corner.” 


Ed. Note: The Winter 1983 issue of 
the Review featured a description of 
GAO’s electronic workstation tech- 
nology in its “On Location” feature. 


“The Mechanization of Office 
Work.” By Vincent E. Giuliano. Re- 
viewed by Morton A. Myers, Direc- 


tor, PAD. 


As GAO continues to introduce 
electronic workstations and_in- 
crease word processing capabilities 
during the 1980’s, we need to be 
aware of the implications involved 
in shifting from paper to electronics. 
In this article, author Vincent 
Giuliano discusses change in the 
nature of office work, in the uses of 
information and communications, 
and in the meaning of the office as a 
particular place occupied during 
certain hours—all in the context of 
stages of office development. 


Giuliano contends that the work- 
place has evolved in three stages, 
each characterized by its level of 
technology, personnel practices, 
and worker-client relationships. The 
preindustrial stage developed in the 
mid-19th century still exists in many 
small business organizations where 
handling large or complex trans- 
actions is not required. The in- 
dustrial stage introduced the pro- 
duction-line concept, in which tasks 
were standardized. In this stage, 
problems developed as workload in- 





creased, and employee morale suf- 
fered. The information-age stage 
(marked by the advent of the micro- 
computer) incorporates the best 
aspects of earlier stages while in- 
creasing the workload and effi- 
ciency, and sustaining employee in- 
terest. 

The graphics accompanying Giuli- 
ano’s article are illuminating as well 
as attractive. Several detailed il- 
lustrations show how changing 
workflow patterns can increase the 
productivity of an office, and projec- 
tions are given of what the work- 
place may be like in the not-too- 
distant future. This article is worth- 
while reading for GAO management 
and administrative personnel. 


Ed. Note: We considered the follow- 
ing article especially pertinent to 
GAO staff in view of the agency’s re- 
cent acquisition of automated of- 
fice equipment for its professional 
and managerial staff around the 
country. Noteworthy is the fact that 
the same ingredients deemed so ne- 
cessary (in the article) to the suc- 
cessful introduction of automated 
office tools are now present at GAO 
and are guiding its use of those 
tools. A Steering Committee on Au- 
tomated Management Systems has 
been set up to direct the devel- 
opment of a new internal adminis- 
trative management system and the 
introduction of electronic worksta- 
tions to the professional and mana- 
gerial staff. The committee advises 
divisions and offices on the acquisi- 
tion of new equipment and on train- 
ing staff. Also, it has emphasized 
the need for top management to be 
involved and committed to the new 
technology. To date, new adminis- 
trative equipment has been in- 
troduced in all the GAO regional of- 
fices and in nearly all of its Wash- 
ington divisions. The administrative 
Staff has been trained to use the 
new equipment and can increase its 
proficiency by using equipment ina 
practice room in the Pension Build- 
ing. An extensive users’ manual for 
identifying the most appropriate use 
of the equipment is being devel- 
oped, as well. 


“Managerial/Professional Produc- 
tivity.” By Harvey L. Poppel. Re- 
viewed by Francis X. Fee, Assistant 
Comptroller General, Operations. 


In this article, Harvey Poppel, sen- 
ior vice president of Booz-Allen and 
director of the firm’s Worldwide 
Systems Practice, summarizes the 
results of a major survey done by 
the firm on the productivity of the 
managerial and professional staff in 
private- and public-sector organiza- 
tions. The study examined the pro- 
ductivity of 300 typical managers 
and professionals, analyzing how 
they spent their time and identifying 
the productivity improvements that 
were available through the use of 
newer, automated technologies. 


Mr. Poppel maintains that signifi- 
cant productivity improvement can 
be made at the managerial and pro- 
fessional levels through office 
automation. He also identifies sev- 
eral actions that an organization 
can take to realize those productiv- 
ity gains. The results of the study 
are summarized below. 

Most of the office productivity im- 
provement efforts that had been un- 
dertaken to date have focused on in- 
creasing the output of clerical and 
support staff. However, with mount- 
ing demands on the time of manag- 
ers and professionals, much more 
needs to be done to identify ways to 
use the skills and capabilities that 
they bring to an organization. Until 
very recently, managers and profes- 
sionals, despite their mounting in- 
formation needs, have had to rely on 
the same information resources— 
pen, paper, typewriter—used in pre- 
vious generations. The Booz-Allen 
study showed that from 15 to 40 per- 
cent of a manager’s or professional’s 
time was spent on activities they 
considered underproductive. This 
category includes such activities as 
searching for information or people, 
copying, scheduling, and traveling 
to or from meetings that could be 
avoided if more accurate and timely 
information was available. 

These timewasters were among 
the most vulnerable professional ac- 
tivities that could be attacked with 
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the introduction of advanced tech- 
nology. Booz-Allen found that man- 
agers and professionals could save 
approximately 15 percent of their 
time by introducing more advanced 
technologies. Further, by providing 
such workers with more advanced 
technologies and equipment, the 
quality of life of managers and pro- 
fessionals increased significantly. 


Use of office automation resulted 
in improved quality of work output in 
terms of substance, content, thought- 
fulness, timeliness, and accuracy; 
expanded the quantity of work out- 
put in that the manager and profes- 
sional provided broader scope and 
coverage with a higher yield and ab- 
sorption rate; and reduced the input 
time required to produce informa- 
tion needed for sound decisions. 


The article identifies several in- 
gredients required to take advan- 
tage of the productivity gains that 
were available through using more 
advanced technologies. 

User receptivity to new technol- 
ogy is not a major obstacle. Most 
senior executives interviewed by 
Booz-Allen have expressed a posi- 
tive “gut feel” for the potential of 
the new, automated, office-support 
tools. However, they have been 
skeptical about how to translate the 
potential benefits into a tangible 
return on investment. Booz-Allen 
found, however, that the average an- 
nual return on office automation in- 
vestments was well over 50 percent. 
The major obstacle, rather, seems 
to be the magnitude of financial and 
people resources needed to achieve 
widespread use. Some of the steps 
that must be taken to assure the 
success of new office technologies 
involve adequate planning, prior 
small-scale testing; and the commit- 
ment from senior management to 
the success of the program. The pro- 
gram can be administered by estab- 
lishing a top-level steering commit- 
tee responsibie for demonstrating 
the new equipment and introducing 
it to the workplace. Often a lower 
level steering committee or a task 
force is established to introduce 
and manage the actual demonstra- 
tions themselves. 
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“Impact of New Electronic Technol- 
ogy.” By Richard W. Riche. Re- 
viewed by Richard L. Brown, Direc- 
tor, GS&C. 


Technological change is key- 
punching its way into nearly every 
corner of our daily lives, from the 
food we eat, the clothes we wear, 
cars we buy, even the job we do in 
GAO. Richard W. Riche, in his arti- 
cle entitled “Impact of New Elec- 
tronic Technology,” discusses the 
effect of four major technological 
changes on the U.S. work force. The 
changes are 
e microprocessors and microcom- 
puters, 

e industrial robots, 
e telecommunications, and 
© office automation. 

Mr. Riche contends that increased 
use of technology generally means 
improved productivity, although its 
impact is felt in varying degrees in 
different industries. This is _par- 
ticularly true in industries where 
electronic technology can either 
replace employees doing routine 
clerical or blue-coliar tasks or make 
their jobs more efficient. When it 
comes to a professional’s use of 
electronic technology (such as 
might be the case in GAO), produc- 
tivity gains become less clear. 
Rather than streamlining jobs or 
reducing workloads, modern tech- 
nology seems to provide profes- 
sionals with new information and 
the ability to perform tasks they 
have been unable to do before. In 
fact, the number of clerical workers 
in the United States has grown by 
more than 9 million since 1960 and 
represents an additional 4 percent 
of the total work force. This in- 
crease is largely due to the fact that 
the computer has enabled manag- 
ers and other professionals to get 
reports and do analyses they could 
never do before. This phenomenon 
has created a need for more clerical 
workers to support increasing 
demands for information. 


In summary, the development of 
electronic technology has created 
more jobs, although those jobs re- 
quire a different set of skills and 
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disciplines than they did 20 years 
ago. In the next few years, for exam- 
ple, we can certainly expect to see 
significant change in the skills 
needed by GAO auditors as a result 
of changing electronic technology. 
The work challenge facing us today 
is to develop a work force capable of 
supporting rapid technological 
changes in U.S. industries. 


“Why Employment Relationships 
Are Changing, and What You Can 
Do About Them.” By Frank T. Wydra. 
Reviewed by Johnny Finch, Asso- 
ciate Director, GGD. 


If you want to remember today’s 
jobs, you’d better examine them 
quickly. Frank Wydra, Vice Presi- 
dent of Human Resources for Har- 
per Grace Hospitals in Detroit, says 
that the computer boom soon will 
make these jobs obsolete or at least 
excitingly different. 

Current strides in electronic tech- 
nology are changing many aspects 
of the work world. With so much 
happening so fast, it is sometimes 
difficult to understand what implica- 
tions these changes have for the 
way we live and work. In this regard, 
Wydra’s article provides some good 
insight on what we can expect from 
the computer revolution. 

As a basis for comparison, he as- 
serts that the traditional employ- 
ment relationship has certain char- 
acteristics. The relationship 
becomes fixed in that both work and 
job continuity are assumed, with 
higher pay traded sometimes for in- 
creased job security. Overall, the 
relationship is one that attempts to 
reduce risk for both the individual 
and the organization. Within this 
relationship, organizations that 
reduce risk, that can generate work 
for employees, and that can succeed 
indefinitely are viewed as good 
employers. Employees who are loyal 
and cause few disruptions are 
viewed as good employees. The 
prevailing norm is one of stability. 

Wydra points out, however, that 
the traditional relationship is begin- 
ning to change. The matrix organiza- 
tion, for example, has introduced us 
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to a shifting organizational struc- 
ture where a worker has multiple 
bosses. Jobsharing, flextime, and 
other work scheduling practices are 
also providing alternatives to the 
“nine-to-five’ routine. With these 
changes have come new forms of 
organization, compensation, and 
communication; different kinds of 
training; and new approaches to 
administration of benefits. 

The effect of these changes, 
small though they presently are, 
warrants our examination to deter- 
mine if the trend will continue. 
Wydra says that the changes have 
been made possible by advances in 
electronic technology—the com- 
puter and its ability to process and 
sort huge volumes of information. 
He also predicts that the trend will 
continue because the increased effi- 
ciency in travei time and energy, as 
well as pressures to increase pro- 
ductivity, all provide economic in- 
centives to both employer and 
employee to continue innovation in 
the employment relationship. One 
by one, these innovations will recast 
the relationship between employer 
and employee. 

Wydra concludes that this change 
is inevitable because it promises 
more efficiency than is available in 
our present system. Greater employ- 
ee independence, flexibility, par- 
ticipation, and self-reliance will lead 
to production of more goods and 
services at lower costs. In sum, 
Wydra believes that through elec- 
tronic technology, the traditionally 
inefficient worker is about to 
become efficient. 


“Office Productivity Is an Eighties 
Imperative.” By A. S. Welch. Re- 
viewed by A. F. Franklin, Director, 
OOHD. 


In this article, A. S. Welch main- 
tains that productivity in the office, 
as it relates to clerical procedures, 
has not kept pace with other im- 
provements in productivity in other 
areas. He points out that there is a 
large gap between the equipment 
support for the clerical worker as 
compared to that supporting other 
functions. The author says that the 
automation of clerical functions 
would permit administrative support 
personnel to do just that: support 
their supervisors. Relieving execu- 
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tives of as much of the support work 
as possible allows them more time 
to engage in pure management or 
problemsolving, thus resulting in 
improved productivity. 

Welch pinpoints the major factor 
that will determine the success of 
this change to automation, namely 
the attention we pay to the human 
factor. He says that we need to be 
aware that solving the productivity 
problem in clerical work is not as 
simple as unplugging one machine 
and plugging in another. It is impor- 
tant that the skills, capabilities, and 
emotions of the staff be considered 
when deciding which type of equip- 
ment would help in the automation 
process. The author suggests that 
the equipment is available. How- 
ever, he says that people must adjust 
to these automated developments 
and that the changing work force 
and a trend toward unionization of 
clerical personnel also will affect 
this adjustment. He contends that 
these pressures will demand that 
management come to grips with the 
human factor and sharpen its 
human relations skills so that it can 
respond more effectively to the 
needs of the employees. 

To increase its consideration of 
the human factor even further, man- 
agement must increase its empha- 
sis on education and training to 
keep abreast of progressive technol- 
ogy and personnel trends. 
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Topics in Evaluation 


This issue’s topic is 
content analysis. 


An SES contract, a description of 
a Federal education program, and 
Alexander Pushkin’s novel Eugene 
Onegin: what do they have in com- 
mon? Each has a message and has 
been examined by means of a tool 
called content analysis. While re- 
cent columns of “Topics in Evalua- 
tion” have focused on evaluation 
concepts, we turn now to a par- 
ticular technique for getting an- 
swers to certain evaluation ques- 
tions. Readers who wish to go 
beyond this brief overview should 
obtain copies of the IPE Methodol- 
ogy Transfer Paper entitled Content 
Analysis. 


What Is Content 
Analysis? 


Messages, taken in the most gen- 


Carl E. Wisler 


Mr. Wisler is an associate director in GAO’s 
Institute for Program Evaluation. 


eral sense, are necessary to human 
interaction. Mass media communi- 
cations, government and business 
transactions, and personal ex- 
changes all carry messages. Con- 
tent analysis is a tool for drawing 
reliable and valid inferences about 
such messages. It is a tool which 
has evolved over the last 80 years 
and has been applied to many pur- 
poses outside of evaluation. In this 
article, we shall be primarily con- 
cerned with how to use content 
analysis to help evaluate govern- 
ment programs and policies. 
Though the analysis of docu- 
ments is our main concern, the 
method is not limited to written 
communications. Examples of the 
wide variety of documents that GAO 
draws from in doing evaluations 
include program descriptions (CED- 
82-52), insurance claims (CED-82- 
68), safety condition reports (EMD- 
81-108), and evaluation reports 
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(PAD-78-44). These and many other 
forms of communication can be sys- 
tematically examined using content 
analysis. 

The essence of content analysis 
is the conversion of written informa- 
tion into a form more conducive to 
interpretation. For example, sup- 
pose we were studying safety faults 
in nuclear power plants and wished 
to know whether a reported fault 
varied by type of monitoring: self- 
report or independent inspection. 
Content analysis could be applied 
to safety condition reports to 
classify faults, yielding a frequency 
count by fault type. Then, standard 
Statistical analyses could be per- 
formed to determine if certain kinds 
of faults were more likely or less 
likely with self-reporting or indepen- 
dent inspection. 

In many content analyses, the 
aim is to convert messages from 
written, narrative form into a quan- 
titative form that can be interpreted 
by using common data analysis 
methods. The challenge is to make 
the conversion in a reliable and valid 
way, a point we shall return to later. 


Doing Content 
Analysis 


To illustrate the main steps in do- 
ing a content analysis, we will use 
the Federal Crime Insurance Pro- 
gram (CED-82-68). The program of- 
fers insurance against burglary, rob- 
bery, theft, and similar crimes. In 
1981, 72,782 policies were in force, 
and $38.4 million was paid out in 
claims. In the same year, premiums 
totaled $13.1 million. The deficit of 
$25.3 million indicates the extent to 
which the program is subsidized by 
transfers from another insurance 
program. 

As part of our review of the pro- 
gram, suppose we want to know the 
probability of policyholders making 
claims on certain categories of 
property, given various character- 
istics of the policyholders and loca- 
tions of property. If data are avail- 
able, statistical techniques can be 
used to estimate such probabilities. 
Content analysis helps provide the 
necessary data by extracting it from 
written material by a process known 
as coding. 

Using file information about the 
72,782 policyholders, our attention 
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will be focused on learning the ex- 
tent to which property, in various 
categories, is reported as stolen. 
The process involves five steps 
common to all content analyses: 
(1)choosing a sample of written 
material for the content analysis, (2) 
selecting units of analysis, (3) devel- 
oping coding categories, (4) coding 
the written material, and (5) ana- 
lyzing and interpreting the coded in- 
formation. 

The first step is to choose written 
material for analysis. The under- 
writer’s files on all policyholders 
will constitute the universe upon 
which the analysis will be based. 
Because the number of files is quite 
large, a sample must be chosen. The 
principles of statistical sampling for 
content analysis are the same as for 
other methodologies and will be 
considered outside the scope of this 
overview. 

The next step is to select a unit of 
analysis. This means putting a 
boundary around the written mate- 
rial to be coded. A policyholder’s 
claim for losses, a part of each file, 
is a reasonable choice as the unit of 
analysis because it is a well-defined 
set of papers which almost certainly 
describes the property in question. 
Often in content analysis, the defini- 
tion of a unit of analysis is more 
complicated than in this particular 
example. 

The third step is to develop cate- 
gories for the conversion of informa- 
tion from policyholder files to quan- 
titative information. Such property 
categories as jewelry, entertain- 
ment equipment, business machines, 
and retail goods are among the can- 
didates. For the purpose of our ana- 
lysis, an important category is a no- 
claim for stolen property. Two prin- 
ciples which guide the development 
of categories are that the categories 
be exhaustive of all possibilities 
and that no piece of information be 
coded into more than one category. 

The hard labor of content analysis 
comes in the next step: coding the 
written material. In our example, we 
have focused on only one class of 
information—categories of property 
reported stolen—but ordinarily a 
content analysis applies to multiple 
classes of information. Typically, a 
team of analysts undertakes the 
coding and, to ensure uniformity 
and accuracy, the team is furnished 
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with codebooks and trained in the 
procedures. Each team member 
reads a portion of sampled mate- 
rials and codes each class of infor- 
mation. For such information as 
reported stolen property, the coders 
simply record a tally mark for each 
category observed. 

Once the sample of written mate- 
rial has been coded, it is ready for 
analysis and _ interpretation. The 
methods are standard data analysis 
techniques ranging from simple de- 
scriptive and inferential statistics 
(see “Topics in Evaluation,” Fall 
1982) to more advanced procedures, 
such as log-linear models, for esti- 
mating the relationships among 
categorical variables. Because the 
data analysis techniques are not 
unique to content analysis, ap- 
propriate methods can be found in 
Statistics texts and need not be 
covered here. 


The Reliability and 
Validity of Content 
Analysis 


Content analysis may be con- 
sidered a measurement process and 
therefore the concerns we have 
about the quality of any measure- 
ment process will apply. Two in- 
dicators of the quality of a measure- 
ment process are reliability and 
validity. (See “Topics in Evaluation,” 
Summer 1982.) 

Reliability is an indicator of the 
extent to which the results of a mea- 
suring process are replicable. In 
content analysis, if we repeat the 
coding process using the same 
sample of material and the same 
definitions of categories, but use a 
different team of coders, we are 
likely to get different results be- 
cause the coders will occasionally 
make. different judgments about 
how to categorize the written mate- 
rial. When differences are small, the 
reliability of the coding is said to be 
high. One of the reasons for having 
codebooks and training coders is to 
achieve high reliability. Procedures 
exist for making quantitative esti- 
mates of the reliability of the coding 
process and should be applied 
before using the results of a content 
analysis. 
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Looking South: 
The Latin America Branch 
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Spanning the Panama Canal, the Bridge of the Americas joins North and South America. 


Author F. Marvin Doyal would like 
to thank members of the Latin Amer- 
ica Branch staff for their assistance 
with this article. 


Recently the United States has 
been paying a lot of attention to our 
southern neighbors in Latin Amer- 
ica and the Caribbean. This area 
dominates our energy pipeline, pro- 
vides markets for our exports, and 
offers political, social, and 
economic challenges. For these 
strategic, commercial, and human 
reasons, the United States is seek- 
ing and cementing new friendships 
in the area. The Latin America 
Branch (LAB), one of the Interna- 
tional Division’s three branches, 
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provides a GAO presence in this in- 
creasingly important geographical 
area. Through this article—profiling 
LAB and its geographical area of 
responsibility—we share a bit of the 
history, importance, and enjoyment 
of our Latin American experience. 


Tiajuana to Tierra Del 
Fuego Plus the 
Caribbean 


The branch’s geographic area of 
responsibility covers what is known 
as Latin America—Mexico and Cen- 
tral and South America—plus the 
Caribbean island nations and ter- 
ritories that generally define the 


northern and eastern limits of the 
Caribbean Sea. The physical ap- 
pearance of the land in this area 
varies greatly, from the Panama 
Canal crossing the continent at 85 
feet above sea level to Chile’s 
snowcapped Andes, from Barbados’ 
idyllic beaches on the peaceful blue 
Caribbean to the Magellan Strait’s 
penguin-populated, stormy seas. 
The people are as diverse as the 
geography. Indians, blacks, cauca- 
sians, and orientals are all widely 
represented, each contributing from 
their individual cultures to the uni- 
que culture of the region. Spanish is 
the language most frequently 
spoken, but in Haiti, one will hear 
French or Creole; in Brazil, Por- 
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and Brazil’s national product ex- 
ceeds the combined national prod- 
ucts of Indonesia, the Philippines, 
South Korea, Hong Kong, Thailand, 
Malaysia, and Singapore. Other 
Latin countries, though not as large 
as Brazil, have their own cultural 
heritages which, in some cases, 
date back to the advanced civiliza- 
tions of the Mayans, Incas, and 
Aztecs who flourished long before 
Columbus discovered the New 
World. 





=. GAO in Latin America 
Ocean 
While national attention has only 
= 4, The Bananas recently increased on Latin Amer- 
‘ semanas ica, GAO has a long history in the 
Cubs Ns" Dominican Re. and the Caribbean area. The earliest presence was 
peice Jah He” 5 rigun and Batoute related to Panama Canal audits. The 
ena Honguras & weeonont goeune list of persons who contributed to 
aia: all Ree te this work reads like a GAO version 
coxa Rea, ee of “Who’s Who.” For example, the 
1947 crew included Oye Stovall and 
Adolph T. Samuelson, both of whom 
became division directors. Others 
are too numerous to mention, but 
veterans include a_ substantial 
number of GAO’s senior staff today. 
Even though canal audit work was 
important in the early days and re- 
mains so today, it was not the only 
work done in the area. During the 
1960’s and 1970’s, numerous GAO 
auditors from the United States 
trooped through Latin American 
countries to perform “country-wide 
reviews” and ‘“‘country cognizance” 
(COCOG) reviews. The travel 
demands and costs of this work, 
coupled with the desires of then 
Comptroller General Staats to in- 
crease GAO’s presence in the 
region, led to the Latin America 
Branch’s creation 8 years ago. 
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tuguese; and in Jamaica, English. {| 
Although English is widely spoken | Panama 
or at least understood, the LAB staff 
has all found that a little bit of 
Spanish goes a long way toward en- 
hancing the experience of living and 
traveling in Latin America. 


Many countries in the region are 
large and highly sophisticated. 
Latin America boasts three of the 
five largest cities in the world—Sao 
Paulo, Mexico City, and Rio de 
Janeiro—each having a population 
over 10 million. Further, Brazil’s 
population (120 million) equals that 
of France and Germany combined, 
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Early July 1975 marked the arrival 
of our first director, George L. 
DeMarco, in the Republic of 
Panama. He supervised the work of 
setting up our first office in the 
Edificio de Diego, the building 
which also housed the American 
consulate. In 1979, the office was 
moved one block to our current loca- 
tion on the fifth floor of the Edificio 
Aseguradora Mundial. Like the 
original office, this building over- 
looks Panama Bay, where ships 
queue awaiting transit through the 
canal. Since LAB’s start in 1975, the 
number of assigned staff has grown 
from 5 auditors and 1 administrative 
staff to our current level of 14 
auditors and 2 administrative staff. 
During the interim, the director’s 
baton has been passed to Wayne T. 
Tucker, John P. Competello, and 
Thomas Brogan, LAB’s_ present 
director. 


Living in Panama 


Even though Panama is only 2% 
hours flying time from Florida, it 
offers a truly foreign living ex- 
perience for LAB staff. Although 
predominantly Latin, Panama has 
an international flavor. Influenced 
by a variety of cultures—European, 
Asian, Jamaican, and American— 
which were brought together during 
the building of the canal, many 
Panamanians proudly claim that 
their country is more of a “melting 
pot” than the United States. 

Panama is roughly the size of 
South Carolina and has a popula- 
tion of almost 1.8 million. Ciudad 
Panama, its capital, is a modern city 
of 700,000. The country’s topography 
includes beaches, prairies, tropical 
forests, and 11,000-foot mountains. 
The temperature is rather constant, 
with a May-to-December rainy sea- 
son and a January-to-April dry 
season. By the way, in Panama 
there is no malaria, there are very 
few mosquitos, and the water is 
safe to drink. As a result, some of 
our staff who prepared themselves 
with quinine, bug spray, and water 
purification tablets have been very 
pleasantly surprised. 

Something seems to breed ath- 
letes in Panama, and except for a 
few holdouts, the LAB staff mem- 
bers are no exception. Softball, vol- 
leyball, bowling, and now even 
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LAB’s Transisthmian Relay Team celebrates completion of 51 miles. 


aerobics—to salsa music—are 
among our activities. The most 
spectacular, though, is the GAO 
relay team which has twice run from 
ocean to ocean. A few of our more 
determined staff have run occa- 
sional individual marathons. Other 
recreational opportunities abound 
in the area. World-class sailfish and 
marlin roam the Pacific; bass, tar- 
pon, and snook swarm in the 150- 
square-mile Gatun Lake; the Atlan- 
tic coast is a skin diver’s and shell 


hunter’s paradise. Golf courses and 
tennis courts are readily available. 
Sports and spectacles, such as 
horse racing, baseball, soccer, 
cockfights, and bullfights, are also 
available. 

Most of our staff live in medium- 
sized apartment buildings. How- 
ever, unlike staff at ID’s branches in 
Hawaii and Frankfurt, we neither 
live in the United States nor ina U.S. 
enclave. Each staff member has had 
to search out, locate, and negotiate 
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a lease for their residence. Nearly 
all of the searching and negotiating 
are in Spanish, and the lease almost 
certainly will be. Needless to say, 
this is an interesting part of getting 
settled in Panama. 

While we live and work in Panama 
City, the presence of a large Amer- 
ican community in the nearby canal 
area makes it possible for us to en- 
joy many of the comforts of home 
while still living overseas. We have 
access to all Department of Defense 
commercial, educational, medical, 
and recreational facilities. Our ac- 
cess to military facilities also gives 
us opportunities for such things as 
inexpensive boat rental for deep-sea 
fishing and “jungle training” at the 
U.S. Army Jungle Operations Train- 
ing Center. On weekends, we can go 
to the military commissary and PX 
to purchase American products, go 
home and watch a live football 
game on Armed Forces television, 
and later join friends in Panama for 
a night of Latin music, casinos, and 
Panamanian cuisine. By living in a 
foreign country while still having ac- 
cess to U.S. military facilities, we 
feel we have the best of all worlds. 


Traveling in Latin 
America 


When we travel in Latin America, 
we visit some of the most romantic 
and interesting cities in the world. 
Consider, if you will, Rio de Janeiro, 
Buenos Aires, Montevideo, and San- 
tiago. However, we are not restricted 
to major cities and have visited 
totally unknown places where rains 
can raise water level by 10 feet over- 
night and where termite hills domi- 
nate the landscape. Each trip, even 
those in Panama, has the makings 
of an adventure. Here are a few ex- 
amples: 
¢ Two staff members left George- 
town, Guyana, on a Saturday en 
route to Brasilia, Brazil. Five days 
later, they finally arrived—their 
transportation had stopped in Port 
of Spain, Trinidad; Caracas, Venezu- 
ela; Bogota, Colombia; Manaus, 
Brazil; and Rio de Janeiro. (This was 
not exactly according to plan, but it 
made for some good stories after 
the ordeal ended.) 

e Several staff were able to squeeze 
a visit to the isolated Inca ruins of 
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LAB and embassy staff learn how to survive in jungle waters. 


Machu Picchu high atop the Andes 
during their work in Peru. 

¢ Many staff have ventured well into 
the outback in remote areas of Peru, 
Costa Rica, Honduras, Haiti, and 
the San Blas islands of Panama, 
where four-wheel drive vehicles are 
necessities, roads are paths, elec- 
tricity is unheard of, and running 
water means a stream to be crossed 
in dugout canoe. It can be rough, but 
the excitement in being in remote 
villages where even host govern- 


ment officials rarely venture makes 
for interesting stories and fond 
memories. 


Working in the 
Latin America Branch 


Although a substantial part of our 
workload concerns the Panama 
Canal, other assignments we under- 
take address a wide range of issues, 
including development assistance 
concerns, U.S. military matters, 
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trade and investment decisions, and 
other U.S. Government activities. As 
one can imagine, LAB work is as 
stimulating and challenging as it is 
diverse. Examples of recent work 
follow. 


Panama Canal Work 


The Panama Canal was begun in 
1904 and completed in 1914. The 
treaty of 1904 granted the United 
States the right to act as if it were 
sovereign in the Canal Zone. This 
concept was softened several times 
in later years—1936 and 1955—and 
was finally disposed of altogether 
when the Panama Canal Treaty of 
1977 was signed. This treaty was 
implemented by passage of the 
Panama Canal Act of 1979 which 


assigned GAO specific audit duties. —_— - ——— , —_— " - 
The treaty and the act provide for a LAB staff inspect ships going through Miraflores Locks. 
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Canal Area monument to the building of the Canal, with the Bridge of the Americas in the background. 


GAO Review/ Spring 1983 





cooperative relationship between 
the United States and Panama until 
1999, when the canal will be turned 
over to Panama. 

The new treaty and a Canal Com- 
mission Board of Directors (which 
includes foreign nationals of a U.S. 
agency) combine to make our work 
on the Panama Canal even more 
challenging. Each year we are 
required to 
e audit the Commission’s §trans- 
actions, including the payment to 
Panama for public services, 

e certify estimated revenues for 
future years, and 

e provide listings of the cost in- 
curred to implement the treaty and 
the cost of property transferred to 
Panama. 

Unless the law changes, LAB’s 
canal audit responsibility will con- 
tinue until 1999. Currently, the work 


at the Commission requires about 
6 staff years of effort. We deliver a 
minimum of two reports to the Con- 
gress each year and complete others 
as requested, which are addressed 
to the requester or the Administrator 
of the Commission. 

Staff assigned to this work transit 
the canal on the bridge of a merchant 
vessel to gain a perspective of the 
canal enterprise, the people, and the 
country that otherwise would be 
missed. For example, they learn the 
canal goes southeast/northwest, 
not east/west or north/south, as 
most believe, and that the sun rises 
on the Pacific and sets over the 
Atlantic. The marvel of the Panama 
Canal is a thing that must be experi- 
enced. All of us still flock to the 
Miraflores Locks to see the Queen 
Elizabeth li—the largest ship to 
transit the canal—make its annual 
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Development 
Assistance 


The administration, the Congress, 
and the media are increasing their 
attention to development assistance 
in LAB’s area of responsibility. In 
the last year, this attention has 
resulted in our participation in 
reviews of development assistance 
efforts of the Inter-American Foun- 
dation and those of the Agency for 
International Development in Haiti, 
Jamaica, and the Eastern Caribbean. 


Inter-American 
Foundation 


Because the nature and strategy 
of U.S. foreign assistance programs 
in Latin America were under close 


The Queen Elizabeth |i squeezes through the narrow cut in the Continental Divide. 
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scrutiny in the Congress and the 
executive branch, GAO undertook 
an in-depth review of the Inter- 
American Foundation activities. The 
IAF is a semiautonomous Govern- 
ment development corporation char- 
acterized by independence from the 
United States and host governments’ 
short-term foreign policy objectives 
and nonintervention in the affairs of 
groups it supports. During field 
work, LAB staff visited over 66 pri- 
vate, indigenous groups who had 
received IAF grants. These visits 
required trips to remote locations in 
Panama, Costa Rica, Peru, Hon- 
duras, and the Dominican Republic 
to determine how effectively the 
group needs were being met by this 
new type of development assistance. 
LAB staff also met with U.S. mission 
personnel, other private and govern- 
mental development organizations, 
and host government representatives 
in all countries visited to get their 
reactions to the program. 


Haiti 


In 1981, the phenomenon of the 
“boat people” and the concern that 
U.S. economic assistance to Haiti 
was ineffective led GAO to undertake 
an assessment of assistance pro- 
gram effectiveness, the reasons for 
past assistance failures, the ade- 
quacy of planned corrective actions, 
and possible development assis- 
tance options. As part of the field- 
work, LAB staff visited all parts of 
Haiti to observe the attempts to 
improve living conditions. This work 
gave LAB staff a taste of the appall- 
ing poverty and hunger which exist 
so close to the United States, the 
difficulties AID faces in its develop- 
ment efforts, and an understanding 
of why Haitians are so willing to 
crowd into leaky, unseaworthy ves- 
sels for the chance for a better life 
in the United States or elsewhere. 


Elsewhere in the 
Caribbean 


Other islands in the Caribbean, 
though generally considered to be 
tourist havens, face serious devel- 
opment problems. The United States 
is undertaking a major assistance 
effort, more than tripling assistance 
provided to these islands in the last 
several years. Our staff recently vis- 


ited several of the islands (Jamaica, 
Barbados, and five other small East- 
ern Caribbean islands) to review the 
effect this assistance is having. 


Future LAB Role 
in Development 
Assistance 


President Reagan recently pro- 
posed the Caribbean Basin Initiative, 
designed to assist developing coun- 
tries in the Caribbean and Central 
America through an integrated pro- 
gram of trade, aid, and investment. 
Even though much of this proposal 
is still under congressional consid- 
eration, it is clear that development 
assistance efforts in Central America 
and the Caribbean will be empha- 
sized in the future. This increased 
emphasis is likely to result in a con- 
tinued LAB leadership role in the 
development assistance area. 


Trade, Energy, 
and Finance 


Although America’s trade relation- 
ships are still predominantly oriented 
to the east and west, recent eco- 
nomic growth in Latin America is 
beginning to change the trade rela- 
tionships with Latin America. Latin 
America depends on the United 
States for the bulk of its imports and 
provides agricultural products and 
important raw materials in return. 
Mexico and Venezuela are key sup- 
pliers of oil, and Jamaica a major 
supplier of bauxite. In the future, our 
trade links with Latin America will 
likely include more nontraditional 
items. 

In recent years, LAB has partici- 
pated in reviews of the changing 
structure of the international oil 
markets and U.S. efforts to encour- 
age mining investments for strategic 
and critical minerals. Upcoming 
work includes examining U.S. energy 
interests in the Caribbean, including 
reviewing the lessons Brazil learned 
from its program to produce and use 
alcohol fuel as a substitute for fossil 
fuel. 


National Security 


The geographic proximity of Latin 
America and the Caribbean makes 
them vital to our national security. 
Major strategic concerns are main- 


taining unimpeded use of sea lanes 
adjacent to North America and the 
Panama Canal and access to Mexi- 
can and Venezuelan petroleum and 
other raw materials. Further, as our 
closest neighbors and friends, these 
countries are important in gaining 
support for U.S. policies in hemi- 
spheric and international forums. 

Political unrest and _ territorial 
disputes in the hemisphere continue 
to raise security concerns for the 
United States. Specifically, civil vio- 
lence in Nicaragua, El Salvador, and 
Guatemala and territorial disputes 
in the Falklands and elsewhere have 
attracted considerable international 
attention. Recognizing the impor- 
tance of stability in the region, the 
United States is increasing security 
assistance programs and reemphasiz- 
ing planning for military contingencies. 

This is creating additional work 
for GAO and the LAB. For example, 
we recently participated in a review 
which provided the Senate Foreign 
Relations Committee information 
on U.S. military assistance programs 
in El Salvador. Ongoing and planned 
work involves U.S. base access in 
Honduras and U.S. strategic plan- 
ning for the Caribbean basin. 


Management of 
Foreign Affairs 


Consistent with the emphasis on 
budget savings, LAB has also worked 
to improve foreign affairs manage- 
ment to achieve budget savings. 
Latin America is an excellent loca- 
tion for reviews of administrative 
and management practices. There 
are 23 embassies and 20 consulates 
which vary in size from very large 
posts in Brazil and Mexico to small 
posts in Guyana and Suriname. (The 
embassy and consulates in Mexico 
employ about 1,000 people, making 
it one of the largest U.S. missions in 
the world.) Further, many agencies 
are represented here which may not 
be represented elsewhere. For 
example, Federal Aviation Adminis- 
tration officials are stationed in 
Panama, and U.S. Government health 
and agricultural inspectors are 
located in many Central American 
countries. 





See LOOKING SOUTH, p. 53 


GAO Review/Spring 1983 





Patricia A. Cole 


Patricia A. Cole, a GAO evaluator, is cur- 
rently with the Office of Program Planning. 
She joined GAO in 1981 at the Washington 
regional office. She received an A.B. magna 
cum laude with distinction in history and an 
A.M. in history from Duke University. 


The following article was adapted from a 
presentation made in August 1982 at a 
roundtable discussion on ‘‘Robotics: Its 
Impact on Education and Training,’’ spon- 
sored by the Department of Education. The 
material was gathered during a GAO review 
of automated manufacturing technology. 


GAO Review/Spring 1983 


Vocational Education 
and the 
Robotics Revolution 


The subject of robotics is arising 
with increasing frequency in the 
United States. It has become an 
important topic at the collective bar- 
gaining table. Automobile com- 
panies now use robots to symbolize 
quality workmanship. Wall Street 
firms consider companies which 
use robots to be sound investments. 
Can there be any doubt that, as sev- 
eral headlines have proclaimed, 
“The Robots Are Coming, The 
Robots Are Coming?” 


Even the General Accounting 
Office is interested in robots. For 
several years, GAO has looked at 
private-sector productivity and its 
effect on international competitive- 
ness. A 1976 GAO report, ‘“‘Manufac- 
turing Technology—A Changing 
Challenge to Improved Productivity,” 
recommended that manufacturing 
productivity become a national prior- 
ity and that the Federal Government 
strengthen its support for and devel- 
opment of productivity-enhancing 
technology related to manufacturing. 
Since 1976, the Japanese strategy 
of adopting the technology to en- 
hance competitiveness has become 
increasingly visible. In view of the 
growing threat to American indus- 
trial markets, GAO recently reviewed 
the current Federal involvement in 
advanced manufacturing technol- 
ogy, including robotics. The review 
found that, while the technology's 
use does have a positive effect on 
private-sector productivity, it also 
raises many other concerns about 
social effects. 


The machines. that are causing 
such a stir are not the anthropomor- 
phic beings of science fiction. At 
best, they look like giant arms per- 
forming such mundane tasks as lift- 
ing, welding, and painting. In the 
future, they will have rudimentary 
human characteristics like vision 
and touch. They are prized more for 
their nonhuman abilities: robots 
work tirelessly around the clock, 


with unfailing precision and in envi- 
ronments from which humans must 
be protected. Though their appear- 
ance may disappoint science fiction 
buffs, robots are at the center of a 
revolution in manufacturing tech- 
nology which various economists, 
government officials, and business 
leaders claim will rejuvenate the 
Nation’s aging industrial base. 

The robot is the focus of attention 
in the media. However, it is only the 
most visible part of a complete man- 
ufacturing system run by a computer. 
In a computer-aided manufacturing 
system, a computer assists or 
directs manufacturing from design 
of an article through production. 
The payoff is an overall improvement 
in productivity and quality. 

What distinguishes this new 
technology from previous forms of 
automation is its ability to be repro- 
grammed. Previously, “hard” auto- 
mation was built to repeat only one 
operation. Programmable automa- 
tion not only can perform several 
different operations in succession, 
but can also be reprogrammed to 
perform a new set of operations as 
production needs change. 


Automated manufacturing tech- 
nology will play a dramatic role in 
our manufacturing sector and may 
revitalize American industry. But in 
doing so, it will fundamentally 
change the nature of manufacturing 
jobs. The skill shift that will accom- 
pany the new technology will create 
serious stresses on many parts of 
our social structure, but none more 
so than the vocational education 
system. The vocational educational 
system will be given the job of train- 
ing technicians to operate and main- 
tain robots. But a greater challenge 
may be looming ahead. The voc-ed 
system may also have to face the 
formidable task of preparing workers 
to adapt to radical shifts in employ- 
ment trends resulting from this 
technological revolution. 





Students at the South Carolina robotics center become acquainted with their new partner on the production line. Officials 


hope this program will give the State an edge in attracting new industry. 


Training Workers 
for Robots 


Training workers to work with 
robots on the factory floor may not 
solve the larger problems created by 
the new technology, but it is clearly 
the most immediate task facing soci- 
ety. Robotics itself creates a skill 
shift on the production line. Failure 
to meet this shift with properly 
trained workers could seriously im- 
pede introduction of the technology. 

Robotics and other advanced 
technologies generally will cause 
skills to shift upward, since by 
design they usually replace unskilled 
and semiskilled tasks. Manual labor 
jobs, such as welding and assembly, 
will become increasingly scarce as 
more sophisticated, sensory-capable 
robots are developed. 

Most new jobs created by robotics 
will require a variety of technical 
skills not needed for today’s jobs. 
This skill shift may change the defi- 
nition of the factory worker from the 
traditional blue-collar worker to a 
white-collar technician. Preliminary 


results of a study on robotics’ effects 
in automobile plants being con- 
ducted for the State of Michigan 
show significant movement of fac- 
tory jobs from production line to 
professional categories.' 

At present, there are many barriers 
impeding the development of voca- 
tional education programs to train 
these technicians. The training 
equipment remains expensive, 
although the cost of a robot is drop- 
ping and new training robots have 
been developed. Qualified teachers 
are scarce since industry can offer 
higher salaries for people knowl- 
edgeable about the technology. The 
high risk associated with creating a 
program dealing with revolutionary 
technology and unknown demand 
may also deter some institutions, 
especially when scarce resources in 
an era of fiscal austerity may mean 
that existing programs have to be 
cut to make way for this new training. 

One thing, however, remains 
certain. The States and institutions 
which are developing robotics train- 
ing programs feel they will have a 
decided edge in attracting high-tech 


industries to their areas of the coun- 
try. The South Carolina State Board 
of Technical and Comprehensive 
Education has created a robotics 
resource center as part of its Design 
for the Eighties program. South 
Carolina established this program 
as its response to the impending 
technological revolution. Similarly, 
Michigan is creating a program to 
attract high technology businesses, 
including robotics manufacturers. 
Workers trained in robotics are 
essential to Michigan’s plan. 


Future Jobs May Be 
Outside the 
Manufacturing Sector 


Although these educational efforts 
are important, they do not address 
the larger problems which may 
result from introducing the range of 
technologies which compose the 
computer-aided manufacturing sys- 





‘Presentation by John M. Koval, Staff Econ- 
omist, Office of the Governor of Michigan, 
before the Robotics Roundtable, Depart- 
ment of Education, August 19, 1982. 
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Robotics students examine the hydraulic system in a Unimate 21000 robot. (Photo by Kevin A. Rourke, Downriver Community Conference) 


tem. Widespread introduction of 
these systems may create a massive 
job shift between economic sectors. 
This movement could create enor- 
mous job dislocation for workers 
and would require major changes in 
vocational education programs. 

Automated manufacturing tech- 
nology probably will not create as 
many manufacturing jobs as it 
destroys. Fewer workers on the pro- 
duction line is a basic goal of the 
technology. Robotics technicians 
and other workers will be needed to 
maintain and operate the machinery, 
but not in a one-to-one ratio with the 
production workers it will replace. 
Many futurists predict the factory of 
the future will employ only a few 
workers where hundreds were previ- 
ously needed. 

Some observers, including policy- 
makers in Michigan, point to the 
potential for creating a new industry 
to construct the robotics technology 
itself. However, this new industry 
would be highly vulnerable to the 
very technology it will produce. The 
ability of the robotics construction 
industry to take up the employment 
slack caused by the automation of 
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traditionally labor-intensive indus- 
tries is doubtful. In addition, coun- 
tries such as Japan are moving 
aggressively to capture the high 
technology construction market, 
and it is uncertain whether the 
United States will be able to retain 
these jobs domestically.” 


The manufacturing sector’s share 


of total employment in the United 
States is already shrinking. In 1959, 
that figure stood at 24.1 percent. By 
1979, it had declined to 20.6 percent. 
(See table 1.) Some experts predict 





“Is Talk of High Tech Jobs More Political 
Than Real?’’ New York Times, October 24, 
1982. 





Table 1 


Employment by Major Sector, 1959-1979 


Industry Sector 





Total employment 


General government 
Agriculture 

Mining 
Construction 
Manufacturing 


Transportation, communications, and public utilities 6.1 5.3 


Wholesale and retail trade 


Finance, insurance, and real estate 


Other services 
Government enterprises 
Private households 


Source: Bureau of Labor Statistics 


Percent Distribution 
1959 1979 _ 





100.0 100.0 
14.1 15.9 
7.8 2.7 
9 F 
5.4 5.8 
24.1 20.6 
18.8 21.5 
4.1 5.3 
13.6 19.4 
1.4 1.4 
3.7 1.7 








Vocational Education and the Robotics Revolution 


this share could drop to 10 percent 
or less by the end of the century. If 
this shift does occur, other sectors 
would have to account for a greater 
portion of total employment. Yet 
other sectors of the economy which 
have provided job growth in the past 
may be unable to absorb more 
workers during the next two decades. 
Ironically, the same technology which 
makes computer-aided manufactur- 
ing possible—microelectronics— 
also creates new opportunities for 
automation in the service sector, 
thereby raising the potential for 
further job displacement.* 


General Economic 
Conditions Complicate 
the Problem 


The impact of automation on the 
work force cannot be separated 
from the overall health of the econ- 
omy. The current recession has 
slowed new equipment orders and 
thus may retard the introduction of 
advanced technologies. However, 
the recession has also resulted in 
record unemployment rates. Many 
jobs lost to the recession may never 
be recreated as_ labor-intensive 
industries fail to regain their earlier 
levels of production. Assistant Sec- 
retary of Commerce Robert Dederick 
testified recently that the automobile 
industry alone will permanently lose 
500,000 jobs by 1985.* The introduc- 
tion of automation at a time of 
declining market share internation- 
ally may prove to be a double blow 
to automobile assembly workers. 


Challenge for the 
Educational System 


As the parameters of the impact 
of this new technology become 
apparent, so do the challenges fac- 
ing those who must prepare the 
work force. The skills associated 
with programmable automation 
require new, highly technical train- 
ing programs. However, these new 
programs may not need to train as 
many people as traditional voca- 
tional programs, such as welding or 
drafting. Thus, the vocational edu- 
cation system will have to provide 
very expensive training for a rela- 
tively small number of students. At 
the same time, the vocational edu- 
cation system will be confronted 
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with the task of providing trainees 
for the nonmanufacturing sectors, 
many of which will also feel the 
effects of microelectronics. 
Educators will have to reexamine 
the vocational education system not 
only to decide where to place future 
emphasis, but also to prevent stu- 
dents from training for occupations 
which could soon be obsolete. And 
reexamination must extend beyond 
vocational training. Secondary edu- 
cators also must evaluate the ade- 
quacy of existing mathematics and 
science courses as these disciplines 
become prerequisites for obtaining 
highly skilled technical jobs in 
automated technology industries.5 


Displaced Workers Have 
Unique Problems 


Workers displaced by the new 
automation face problems different 
from those of a generation of young 
people just beginning training. These 
workers will need retraining, but itis 
unclear whether employment oppor- 
tunities will exist. The new technol- 
ogy may not create enough new jobs 
to absorb the workers it displaces. 
Many of these workers may not pos- 
sess the technical background nec- 
essary to move into the jobs which 
are created. Furthermore, many 


Unemployed Michigan workers learn new 
skills in a robotics program (Photo by Kevin 
A. Rourke, Downriver Community 
Conference) 


workers with families to feed and 
mortgages to pay will not be able to 
spend 2 years in a traditional training 
program. 

Displaced workers also could 
have age and mobility problems. 
Older workers may be harder to 
retrain. They are also more likely to 
have familial and economic ties to 
geographic locations. Many of the 
new jobs created in the future may 
not be in the industrial heartland of 
the Northwest and Midwest, but 
rather in the Sun Belt States of the 
South and West. Many older workers 
simply may not be able to face the 
uprooting the new jobs would require. 

A Comprehensive Employment 
and Training Act (CETA) demonstra- 
tion project sponsored by the Down- 
river Community Conference in 
Michigan is trying to solve some of 
these problems. The project offers 
training and placement assistance 
to workers laid off because of in- 
creasing import sales and the reces- 
sion. During the past year, the project 
included a robotics training program 
which demonstrated one role for 
voc-ed institutions in retraining dis- 
placed workers. A 2-year community 
college course was condensed to 
36 weeks as workers were retrained 
to build and service robots. At the 
completion of the training program, 
CETA placement services and in- 
dustry contacts were used to find 
the workers new jobs.® 





3Colin Norman, Microelectronics at Work: 
Productivity and Jobs in the World Econ- 
omy, Worldwatch Paper 39, October 1980, 
p. 35. 


“Statement of Robert G. Dederick, Assistant 
Secretary for Economic Affairs, U.S. 
Department of Commerce, before the 
Subcommittee on Employment and Pro- 
ductivity of the Senate Committee on 
Labor and Human Resources, January 12, 
1982. 


5Stanley Pogrow, ‘‘On Technological Rele- 
vance and the Survival of U.S. Public 
Schools,"’ Phi Delta Kappan, May 1982, 
pp. 610-611. 


®Statement of Raymond Uhalde, Office of 
the Assistant Secretary for Planning, 
Evaluation and Research, U.S. Depart- 
ment of Labor, before the Robotics 
Roundtable, Department of Education, 
August 19, 1982. 
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Lack of Information Is the 
Largest Problem 


Perhaps the greatest impediment 
to preparing for the robotics revolu- 
tion is the lack of detailed informa- 
tion about how this new automation 
affects skills and job distribution. A 
1981 study by Carnegie-Mellon 
University sought to identify tasks 
and occupations vulnerable to 
robotics. (See table 2.) Only in the 
past year, however, have plant-level 
studies been initiated to corroborate 
various theories on the effect of 
automation on job displacement. 
And little research has been con- 
ducted to determine at what rate 


A student learns to operate and program a computer which controls a small training robot. 
(Photo by Kevin A. Rourke, Downriver Community Conference) 





Table 2 


Prime Operative Tasks for Robots 


Occupational Title 


Production Painters 
Welder/Flamecutters 
Machine Tool Operators 
Electroplators 

Heat Treaters 
Packagers 

Inspectors 
File/Grind/Buffers 
Assemblers 


4Level | robots have no sensory input. 
>Level Il robots have sensory capabilities, such as rudimentary vision and 


touch. 


Source: The Impacts of Robotics on the Workforce and Workplace, Department 
of Engineering and Public Policy, and School of Urban and Public Affairs, 
Carnegie-Mellon University, 1981, p. 99. 


this displacement will occur. 

Unfortunately, without information 
on the new automation’s potential 
for skill change, educators and 
social planners cannot properly 
design programs to handle future 
educational demands. 


Consequences of Not 
Being Prepared 


In human terms, the possible 
consequences of not preparing for 
future skill shifts range from a few 
thousand workers being dislocated 
to a dramatic increase in the number 
of unemployable people in the work 
force. 
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Level | robots? 


Percent of Tasks Performed by 
Level II robots® 


44 
27 
20 
20 
10 
16 
13 
20 
10 





No one disputes that computer- 
aided manufacturing will displace 
workers. The real question is whether 
these workers will become perma- 
nently unemployed. Traditionally, 
retraining has not been the respon- 
sibility of vocational education 
institutions, but certainly they could 
play a critical role in providing the 
work force with new skills. However, 
these institutions can fulfill this role 
only if their curricula are expanded 
to meet this new demand. 

Failure to close the gap between 
the latest technological demands 
and the vocational curricula offered 
could lead to several serious prob- 
lems. First, students could end up 


being trained for obsolete occupa- 
tions. For example, students train- 
ing today for jobs as welders or 
drafters may soon find themselves 
replaced by robots and computer- 
aided design techniques. Second, 
students may be properly trained for 
new manufacturing occupations but 
in numbers that far exceed the num- 
ber of jobs the new technology will 
create. And, finally, there is the 
potential for an increase in the num- 
ber of people who have none of the 
skills in demand. Would-be workers 
without skills, or with the wrong 
skills, will have no place to start in 
the job hierarchy. This condition is 
already becoming a problem and will 
only grow in magnitude unless these 
people can be channeled into train- 
ing programs offering appropriate 
skills. 


The Federal Role: 
Coordinating Future 
Policy 


The Federal role in future voca- 
tional training has been the subject 
of intense debate, but policy incon- 
sistencies continue. For example, 
federally sponsored research may 
hasten the development of robots 
with sensory capabilities, but little 
Federal effort has been devoted to 
determining the social impacts of 
these machines. Existing tax policies 
encourage industry to invest in cap- 
ital equipment but provide little in- 
centive to invest in training workers. 

More than any other institution, 
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Auditing, Evaluation, 
and Management 
Improvement — The 
Canadian Experience 


Since 1981, GAO has been experi- 
menting with ways to study broad 
organization and management 
issues. These studies have been 
aimed at answering one question: 
how well or poorly is an agency 
being managed? 

Three GAO divisions have under- 
taken studies at several Federal 
agencies, including the Department 
of Housing and Urban Development 
(HUD) and the Federal Emergency 
Management Agency (FEMA). The 
General Government Division estab- 
lished a separate unit—the General 
Management Studies Group (GMS)— 
to develop expertise in making 
broad-based management assess- 
ments and to assess the extent to 
which the Office of Management 
and Budget and other central man- 
agement agencies provide the guid- 
ance and support needed to ensure 
that Government programs are 
effectively managed. 

While GAO has broadened its per- 
spective substantially in recent 
years, its reviews have focused gen- 
erally on either programmatic issues 
or individual administrative activ- 
ities, such as budgeting, personnel, 
or procurement. The perspective of 
the total organization responsible 
for a given set of programs was 
missing, however, as was the sense 
of how activities, such as planning, 
budget, and evaluation fit together 
to support an entire organization or 
management system. 

Early in 1982, Comptroller General 
Charles A. Bowsher indicated that 
finding ways to conduct these 
broad-based management studies 
would receive high priority. While 
testifying on GAO's fiscal year 1983 
appropriations, he announced this 
effort as one of three major new 
initiatives. 

Around that time, he traveled to 
Canada to look at how our northern 
neighbors performed work similar to 


GAO’s. There he was briefed on two 
activities relevant to the manage- 
ment studies initiative: 

e the comprehensive audits con- 
ducted by the Auditor General’s 
office and 

e the IMPAC program, a major man- 
agement improvement effort carried 
out jointly by the Office of the 
Comptroller General and the individ- 
ual executive departments in the 
Canadian government. 

When he returned, he asked 
Bill Anderson, director of the General 
Government Division, and me to 
make a follow-up visit, an assign- 
ment we were more than pleased to 
accept. As it turned out, we made the 
trip in August, a delightful month in 
Ottawa and one of the muggiest in 
Washington. 

Our 3-day trip took us to several 
offices in the Canadian Government, 
including the Auditor General, the 
Comptroller General, two executive 
departments, and the Bureau of 
Management Consulting in their 
Department of Supplies and Ser- 
vices. We wanted to find out not 
only how the management improve- 
ment efforts were being implemented 
and assessed, but also how they 
were being received in the agencies 
themselves. 

We conducted our interviews with 
an awareness that there were signif- 
icant differences between the Cana- 
dian system and our own. For 
example: 

e Canada functions under a parlia- 
mentary system. Funding and policy 
decisions are made almost entirely 
in the executive branch by the Prime 
Minister and his cabinet. 

e Canada has only about one-tenth 
the U.S. population, and its central 
government is proportionately 
smaller than ours. 

¢ Canada has much clearer separa- 
tion in functions between the central 
and provincial governments than 
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exists between our own Federal and 
State governments. 


Policy and 
Expenditure 
Management 


The concept we found most striking 
about the Canadian approach to gov- 
erning was a mechanism called the 
Policy and Expenditure Management 
System (PEMS). Introduced about 
3 years ago, PEMS is a government- 
wide planning and management 
scheme designed to ensure greater 
control over the management of pol- 
icies and expenditures. Like our 
own recent history, Canada’s 1960’s 
and early 1970’s were marked by sig- 
nificant policy and program expan- 
sion as well as great organizational 
growth and change in government. 
By the mid-1970’s, it became clear 
that the central government had to 
follow a policy of restraint to control 
escalating inflation and the growing 
gap between expenditures and 
revenues. 

PEMS is a conscious attempt to 
alter the decisionmaking process in 
a way which more clearly delineates 
the government’s objectives within 
the context of available resources. 
A major effort was made to bring 
together policy decisions and re- 
source allocations in a longer term 
perspective. The objective is to 
ensure that policy and program 
decisions are made with full knowl- 
edge of cost and expenditure limits 
and that, in turn, expenditure deci- 
sions are made with an understand- 
ing of the government’s policies and 
priorities. 

Figure 1 summarizes Canada’s 
policy and expenditure planning 
cycle. Two significant features in 
the new system are 
e long-term fiscal planencompassing 
government revenues and expendi- 
tures over a 5-year period, i.e., setting 
out the overall financial constraints 
within which policy choices must be 
considered, and 
e expenditure limits—resource 
“envelopes’”—for policy sectors, 
which are related to the government 
priorities, with a particular cabinet 
committee assigned the responsi- 
bility for managing each policy 
sector’s resources. 

Figure 2 provides a list of cabinet 
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Figure 1 


POLICY AND EXPENDITURE PLANNING CYCLE 





ECONOMIC 
OUTLOOK, 
FISCAL 
FRAMEWORK 


FINANCE 








PRIORITIES SETS OVERALL 
AND DIRECTION AND 
PLANNING ENVELOPES 








POLICY 
SECTOR 
OUTLOOK 


RO ay 

EXPENDITURE 

OUTLOOK 
PREPARE STRATEGIC 
OVERVIEWS AND 
OPERATIONAL PLANS 
a 


SEPT DEC/JAN 


POLICY 
COMMITTEES 











TREASURY 
BOARD 


DEPARTMENTS 





| 

| 
REVIEW 
STRATEGIC 
OVERVIEWS 

| 

| 

| 








REVISE 
FISCAL 
IF RAMEWORK') 


| 














= CONFIRMS PLANS. 
—_—_»} DIRECTIONS, & 


a ENVELOPES 


REVISE WORK 


PLANS AND | 
| 














REQUEST 
PROPOSALS 
AND REVIEWS 








‘ie 


} 
REVIEW | Ma 
OPERATIONAL — 
PLANS . 
| Cycle 


Ongoing Submission of 


Proposals and Program Rewews 








Figure 2 


Cabinet Committees and Resource Envelopes 


Cabinet 
Committee 


Priorities and Planning 
Economic Development 
Social Development 
Foreign and Defense Policy 


Government Operations 


committees, policy sectors, and 
resource envelopes. Understanding 
this new system required us to 
absorb a lot of new terminology and 
comprehend its functioning in an 
environment significantly different 
from our own. In summary, it seemed 
that the Canadians have taken seri- 
ously the need for long-term planning 
by matching policy decisions to 
resource allocations and establishing 
a structure which permits govern- 
ment initiatives to be systematically 
implemented. This system provides 
the framework for planning, manag- 
ing, and evaluating government 
programs. 


Resource 
Envelope 


. Fiscal arrangements 

. Public debt 

. Economic development 
Energy 

. Social affairs 

. Justice and legal 

. External affairs and aid 
Defense 

. Parliament 

. Services to government 
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= 





The Auditor General’s 
Role 


The watchdog over all this activity 
is Canada’s Office of the Auditor 
General, which is much like our own 
GAO. This office has existed for a 
little more than 100 years, but only 
recently has it moved beyond the 
traditional financial and compliance 
auditing GAO performed in its early 
years. Armed with a new charter (the 
Auditor General Act of 1977) and a 
staff of more than 500 employees, 
the incumbent Auditor General, 
Kenneth Dye, and his predecessor, 
James Macdonell, have leap-frogged 
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Title 


Figure 3 


SUMMARY COMPARISON 
GAO 





Comptroller General of the United States. 


OAG 
Auditor General of Canada. 





Term 


15 years 


10 years 





Office 


United States General Accounting Office (GAO) 


Office of the Auditor General of 
Canada (OAG) 





Mandate - 
Legislation 





The Budget and Accounting Act, 1921, as amended. 

Government Corporation Control Act, as amended. 

Legislative Reorganization Act of 1946. 

Accounting and Auditing Act of 1950. 

Legislative Reorganization Act of 1970, as amended by 
Public Law 93-344, July 12, 1974 (88 Stat. 297). 

Budget and Impoundment Control Act of 1974. 

The General Accounting Office Act of 1974. 

The General Accounting Office Act of 1980. 


The Auditor General Act, 1977. 
The Financial Administration Act, 
1970, as amended. 





Scope of Work 


Auditing and Evaluation (Economy, Efficiency and 
Effectiveness). 

Accounting Systems. 

Legal Services. 

Claims Settlement. 

35% initiated by Congressional Request; 65% by GAO. 


Auditing (Economy, Efficiency and 
Procedures for Effectiveness, 
Attest and Authority). 


Virtually all work initiated by 
ffice. 





Reporting 


To the Congress, Committees, and Members of Congress. 


To House of Commons. 





Organization 


Audit Operations by Issue Areas and Lead Divisions. 


Audit Operations by Government 
Expenditure Envelopes. 





Staffing — Professional 
— Other 


4,130 
970 


5,100 


81% 
— 19% 
at September 1981 


386 16% 
125 - 24% 


51) at February 1982 





Offices 


Headquarters — Washington, D.C. 
15 Regional Offices an 


3 Overseas. 


Headquarters — Ottawa. 
6 Regional Offices. 





Standards and 
Methodology 


“Standards for Audit of Governmental Organizations, 
Programs, Activities, and Functions.” 

General Policy Manual. 

Project Manual. 

Report Manual. 


Comprehensive Auditing Manual. 
Audit Guides. 
Accounting and Auditing Bulletins. 





Number of Reports 





GAO’s evolution toward program 
evaluation by conducting several 
ambitious governmentwide studies 
and adopting a comprehensive 
audit approach to assessing depart- 
mental management systems. Fig- 
ure 3 provides a summary compari- 
son between the Auditor General’s 
office and GAO. 

Traditionally, the Auditor General’s 
office examined departmental per- 
formance and expenditure control 
by focusing on isolated examples of 
improprieties discovered during 
field audits of individual transac- 
tions. To provide Parliament with a 
better understanding of the underly- 
ing problems and possible remedies, 
the Auditor General adopted a more 
comprehensive systems-based 
approach, first through a series of 
governmentwide special studies, 
then by means of departmentwide 
comprehensive audits performed on 
a cyclical basis. These department- 
wide audits concentrated initially 
on five interrelated facets: financial 


oe 1,000 per year plus an Annual 
eport — Summary. 


controls, reporting to Parliament, 
attest and authority (financial author- 
ity for disbursements and opinion 
on the financial statements), man- 
agement controls, and electronic 
data processing controls. The man- 
agement controls facet focused on 
the ‘‘systems, policies and proce- 
dures for evaluating and reporting 
on the effectiveness of programs 
and for promoting the economic 
acquisition and efficient use of 
resources,” the so-called value-for- 
money concept. 

To conduct these comprehensive 
audits, teams were assembled from 
the audit staff, experts were housed 
in a separate “Control Evaluations 
Branch,” and outside consultants 
were hired as needed. Each team 
was headed by an audit principal 
and monitored by an audit advisory 
committee consisting of top man- 
agement officials and several out- 
side experts. The focus was on a 
department’s program delivery and 
management systems (internal 


One Annual Report and opinion on 
Public Accounts and opinion on 
Financial Statements of Crown 
corporations. 





audit, planning, financial controls), 
plus the support systems for imple- 
menting programs. The auditors 
determined whether a department’s 
managers established clear objec- 
tives and if they had reasonable pro- 
cedures to measure and report on 
their achievement. They assessed 
whether appropriate procedures 
were in place to plan, direct, and 
control a department’s operations. 
The theory behind this approach is 
that, if the systems were in piace 
and working, then there was a good 
possibility the organization was 
being managed efficiently and 
effectively. 

The Auditor General issues only 
one report a year to Parliament. It 
contains the results of several of 
these governmentwide studies and 
comprehensive audits as well as 
chapters on the office’s other major 
activities. 

When we visited Ottawa, the 
Auditor General’s office was just 
completing its first 5-year cycle of 
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comprehensive audits at the Cana- 
dian departments and agencies and 
was about to launch another. We 
learned that they were rethinking 
their initial approach. Essentially, 
the first round had focused on 
departmental management controls 
and what additional controls were 
needed to ensure ‘“‘value for money.” 
One official told us that the depart- 
ments were “amused” by this ap- 
proach and were beginning to won- 
der just how much overhead they 
needed to get on with their jobs. 
Managers questioned whether the 
Auditor General’s_ rationalistic 
approach was consistent with polit- 
ical reality and the day-to-day de- 
mands confronting managers. 

Ironically, the office seems to be 
heading toward a stronger emphasis 
on program accomplishment and 
systems delivery just at the time 
when GAO is experimenting with 
departmentwide management 
audits. Auditor General staffs may 
be asking whether the described 
services are actually being delivered 
and, if not, why not. Recognizing 
that there is, at best, a tenuous 
cause-and-effect relationship be- 
tween management control proce- 
dures and effective service delivery, 
the auditors are now addressing 
what the systems are actually pro- 
ducing and how organization struc- 
ture and systems can be assessed 
in this context. 

We came away from these discus- 
sions with the feeling that the Audi- 
tor General’s staff was quite proud 
of its accomplishments during the 
initial round of comprehensive 
audits. We also sensed their aware- 
ness that a more sophisticated 
approach which considered the 
daily realities of departmental man- 
agement was needed to fully achieve 
the goal of helping to improve service 
delivery while ensuring that value 
for money was also achieved. 


The Comptroller 
General and IMPAC 


Our next stop was the Office of 
the Comptroller General, an agency 
in the Canadian government’s exec- 
utive branch established in 1978 to 
(1) oversee the quality and integrity 
of financial systems and related 
practices and (2) develop and main- 
tain policies, procedures, and prac- 
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Auditing, Evaluation, and Management Improvement 


tices necessary to evaluate and 
report on the efficiency and effec- 
tiveness of government programs. 
Most of its efforts have been devoted 
to a major governmentwide program 
called IMPAC—Improvements in 
Management Practices and Control. 
The program is headed by Harry G. 
Rogers, former vice-president of 
operations for Xerox of Canada. 


IMPAC was designed to identify 
the current state of management 
practices in Canadian departments 
and agencies, to support the devel- 
opment of departmental “action 
plans” for improving existing prac- 
tices, and to implement these plans. 
By March 1982, about 50 action 
plans had been submitted and 
approved or were being developed. 
The Comptroller General reported 
that about 2,500 to 3,000 people 
were working on IMPAC projects with 
the total one-time cost over 5 years 
estimated at between $200 and 
$250 million (Canadian). OCG has 
less than 100 people working on this 
program, and most of the resources 
and funding are being furnished by 
the departments themselves. 


To supplement departmental 
funding, a temporary fund was 
established under OCG control. This 
fund provided OCG an important 
stimulant for departmental action 
by enabling it to furnish ‘seed 
money” for management improve- 
ment projects. 


In helping to perform the initial 
IMPAC surveys, assisting in devel- 
oping departmental action plans, 
approving those plans, and assist- 
ing with their implementation, the 
most significant OCG role was to 
act as an agent for change. This role 
was fulfilled by OCG liaison officers 
who worked directly with depart- 
mental staffs in developing and 
implementing their action plans. 
Mr. Rogers described their role this 
way: 


Liaison work is a blend of attitudes 
and practices necessary to achieve 
change cooperatively. It involves 
being pro-active and service-oriented 
with departments, including invest- 
ing the time and effort required to 
understand departmental circum- 
Stances and to acquire the back- 
ground necessary to give effective 
guidance and advice. 


Based on our discussions with 
OCG officials, it became clear that 
the IMPAC project was a major 
undertaking that had no parallel in 
the U.S. Government either today or 
in the past. These were the key 
questions: How well was it working? 
How was it relevant to our manage- 
ment studies effort? 

In testimony before a committee of 
Parliament in March 1982, Mr. Rogers 
said that IMPAC had produced 
“noticeable crystallization or clarifi- 
cation” of objectives in at least six 
departments, but there was less evi- 
dence of improved management 
information for better management 
control. He saw IMPAC as a long- 
term educational process that 
offered opportunity to achieve “a 
significant improvement in manage- 
ment practices that will endure.” 

The Auditor General had been 
monitoring IMPAC, and in an earlier 
report had noted the magnitude and 
complexity of the program, observ- 
ing that many of the original surveys 
and action plans had required revi- 
sion and rescheduling. Implementa- 
tion of these plans was taking longer 
than expected, much longer in some 
cases. Major areas where there was 
progress slippage included planning, 
management information, and 
evaluation components. 

OCG officials acknowledged that 
nearly all program schedules had 
slipped, and some improvement 
goals had been changed. However, 
they believed significant progress 
was being made, particularly where 
there were strong cooperative rela- 
tionships between OCG and depart- 
ment personnel. One Assistant 
Comptroller General told us that the 
most successful management 
improvement projects were those 
involving identifiable cost savings. 
He also stressed the importance of 
the seed money in getting agency 
projects started. Another factor was 
the great respect within the Cana- 
dian government for Comptroller 
General Harry Rogers. Managers 
believed he understood their prob- 
lems and wanted to help them. In 
addition, the Comptroller General 
sits on a board which annually rates 
the performance of every depart- 
ment’s top career manager, the 
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Bob Minick 


Bob Minick is an evaluation specialist with 
GAO’s Office of Organization and Human 
Development. Prior to joining GAO in 
January 1981, Bob worked as a consultant 
to the Massachusetts Department of Public 
Welfare for training evaluation. Bob has 
served as a Staff specialist and consultant 
for management and organizational develop- 
ment in public and private nonprofit organi- 
zations. Bob received a Ph.D. in psychology 
with a specialty in evaluation research from 
St. Louis University. His B.A. (Colgate 
University) and M.A. (Boston College) 
degrees are both in psychology. Bob is the 
principal author of an article on the evalua- 
tion of human resource development efforts 
soon to appear in the Training and Develop- 
ment Journal. 


A Model for the 
Systematic Internal 
Evaluation of 
Agencywide Human 
Resource Development 
and Training 


Over the past several years, evalu- 
ators have devoted considerable 
thought to the emerging roles and 
relationships between themselves 
and program managers. In particular, 
they have focused on their shared 
concern for using evaluation informa- 
tion. Unfortunately, the connections 
between management decision- 
making and the domains of formal 
evaluation are not usually well 
defined in the minds of those directly 
involved. Though evidence suggests 
that formalizing evaluation as part 
of the system of management infor- 
mation resources has_ potential, 
guidance is needed to realize this 
potential. This article presents a 
model for considering the role of 
internal evaluation in the planning 
and implementation of agencywide 
human resource development and 
training. 


Integrating 
Evaluation and 
Decisionmaking 
through a 

Systematic Approach 
to Internal Evaluation 


To develop a working concept of 
internal evaluation, we must con- 
sider the kind of information needs 
which can be addressed with evalu- 
ation methods and information sys- 
tems. Although the purposes of 
internal evaluation can be quite 
varied, everyone will agree that the 
aims stem from the information 


needs of key management decision- 
makers. If we consider the common 
demands of managers, three types of 
information needs seem to emerge. 
The first type, which we will call the 
Anticipatory Evaluation, judges the 
value and likely success of programs 
or actions being planned. The second 
type, the Effort and Effects Evalua- 
tion, offers evidence of the quality 
of program implementation, particu- 
larly evidence of program effective- 
ness. Finally, the third type, the 
Organization Impact Evaluation, 
looks at the relatively enduring 
organizationwide impacts of efforts 
within broad functional areas. 

Examples of the objectives encom- 
passed by these three types of 
internal evaluation are presented in 
figure 1. They were taken from the 
model prepared by GAO's Office of 
Organization and Human Develop- 
ment (OOHD) for the evaluation of 
in-house human resource manage- 
ment and development (HRM/D) 
efforts. As these objectives illustrate, 
a comprehensive internal evaluation 
system would require a great deal of 
planning and organization. From a 
management perspective, to keep 
such a comprehensive system cohe- 
sive, all of the organizational deci- 
sionmaking processes, including 
the evaluation components, would 
have to be integrated. Ideally, inte- 
gration would occur (1) within the 
organizational decisionmaking 
cycle, (2) within the management 
decisionmaking structure, and 
(3) through the role of the internal 
evaluator. 
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A Model for the Systematic Internal Evaluation 


Figure 1 





Evaluation Objectives—GAO (OOHD) 


Integrated HRM/D Evaluation Model 
A. Anticipatory Evaluation (Planning phase evaluations) 

Objectives: 

1. Context Evaluation. Purpose: “to provide a ration- 
ale for the determination of objectives.” (Stuffle- 
beam, 1973, p. 136) 

a) To decide if functional and/or program goals 
address relevant human resource development 
needs. 

b) To determine whether functional or program 
goals reflect the priorities set by policymakers 
(strategic rules). 

. Evaluability Assessment. Purpose: ‘(to test) the 
extent to which managers and policymakers have 
defined measurable program objectives and 
defined specific uses for information on program 
performance.” (Wholey, 1979, p. 13) 

a) To determine the degree of ambiguity in human 
resource development program objectives and 
implementation designs. 

b) To assess the plausibility and utility of selected 
objectives and approaches. 

c) To identify program options and alternative 
evaluation designs. 

. Limited Implementation Evaluation. Purpose: to 
provide preliminary evaluation of program perfor- 
mance based on model runs or program pilots. 
a) To identify problem areas in policy or program 

implementation. 

b) To test alternative methods for delivering 
programs. 

c) To test the utility and reliability of alternative 
evaluation designs and instruments. 

B. Effort and Effects Evaluation (Implementation phase 


overall goals of the human resource development 

program or project have been achieved. 

a) To assess the level of program/project goal 
attainment according to agreed criteria or 
standards. 

b) To assess the extent to which intermediate or 
enabling objectives were achieved. (See Kirk- 
patrick, 1975, for relevant examples of measur- 
able human resource development objectives.) 

c) To determine effects of variations in imple- 
mentation program/project goal attainment. 


. Administrative Evaluation. (Aggregated Assess- 


ment of Functional Human Resource Development 

Efforts) Purpose: to assess the relative progress 

among functional lines of human resource devel- 

opment effort using aggregated program evalua- 
tion data, cost estimates, quality assurance, and 
other management data. (See Attkisson, et al., 

1978; Weinstein, 1975.) 

a) To assess the adequacy and reliability of 
administrative data sources. 

b) To array aggregated estimates of current effi- 
ciency and/or cost effectiveness (goal attain- 
ment/cost) among human resource develop- 
ment lines of effort using appropriate auditing 
models. (See Kearsley and Compton, 1981; see 
also Attkisson, et al., 1978, especially ch. 13, 
for human resource development examples.) 
To estimate the degree of policy and/or quality 
assurance (standards) compliance within and 
among human resource development pro- 
grams. (See Attkisson, et al., 1978, especially 
ch. 14, for examples.) 


evaluations) C. Organizational Impacts Evaluation 
Objectives: Objectives: é' 
1. Program Effort Evaluation (Program Management). 1. Predictive Evaluation. Purpose: to estimate current 


Purpose: to determine if the program/project was 
implemented according to the levels agreed on in 
the planning phase. 

a) “To determine if specified target groups or 
organizational domains were appropriately 
included.” (Bernstein and Freeman, 1975) 

b) “To determine if the various practices and 
intervention efforts (were) undertaken as spe- 
cified in the program designs or derived from 

rinciples explicated in the design.” (Bernstein 
and Freeman, 1975, p. 19) 

To obtain evidence of potential! problems with, 
or alternatives to current practices, including 
unintended consequences of program/project 

performance, and cost-saving measures. 
. Program Effect Evaluation. Purpose: to evaluate 
the extent to which enabling objectives and the 


and projected contribution of human resource 

development policies and efforts to organization 

effectiveness. 

Objectives: 

a) To test alternative causal models for explaining 
human resource development contributions to 
organizational effectiveness. 

To project the generalizability and adaptability 
of trial human resource development programs/ 
projects for wider organizational application. 
(“Prognosticative Evaluation” —Snyder, et al., 
1981) 

To audit evaluations in order to summarize 
major learnings about the organizational 
effectiveness. (See Standards for Program 
Evaluation: Exposure Draft, Evaluation Research 
Society, 1980, pp. 7-8.) 





GAO Review/ Spring 1983 





A Model for the Systematic Internal Evaluation 


The Organizational 
Decisionmaking Cycle 


The organizational decisionmaking 
cycle, the most explicit integration 
of internal evaluation and manage- 
ment decisionmaking, is a succes- 
sion of decisions beginning with the 
development of strategic plans 
through the articulation of opera- 
tional plans to the actual implemen- 
tation of lines of effort, programs, 
and projects. Within this cycle, eval- 
uation, either formal or informal, is 
used to ensure the congruence of 
decisionmaking. Figure 2 shows 
how this organizational decision- 
making cycle would play out within 
a common functional area, personnel 
training and development. 

The ideal planning process for an 
agency’s training effort would be 
based on a well-defined set of orga- 
nizational needs and expectations. 
The GAO-OOHD evaluation model 
(figure 1—Anticipatory Evaluation) 
helps training managers translate 
those needs and expectations into 
training objectives by providing 
them the means to assess their 
strategies in light of agency goals 
and objectives. The methods for 
such assessment range from very 
informal deductive procedures to 
sophisticated decision research 
strategies. 

As part of this Anticipatory Evalu- 
ation, training managers can apply 
two other assessments. First, they 
can determine program logic and 
the extent to which measurable 
results are likely to occur through 
the processes of ‘‘Evaluability 
Assessment.” And second, they can 
test the program design through 
pilot runs of the program. 

Once programs have been imple- 
mented, decisions regarding ongoing 
adjustments to training programs 
would be aided by the kinds of 
objectives cited for the Effort and 
Effects Evaluation. Strategic con- 
cerns of both top agency manage- 
ment and training managers are 
addressed in the Organizational 
Impacts Evaluation. 


Due to the recent emphasis on 
risk analysis and decision model- 
ing, the contribution of formal 
evaluation procedures during the 
planning phases of the organiza- 
tional decisionmaking cycle are just 
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Figure 2 
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now gaining serious attention. The 
GAO-OOHD model makes explicit 
some of the decision maintenance 
objectives of such Anticipatory 
Evaluations. These objectives rely 
on comparisons of an implicit na- 
ture; €.g., comparing goals to inter- 
nally defined criteria for accep- 
tance. Very often, the value of An- 
ticipatory Evaluation lies in making 
explicit the criteria for deciding. 

The traditional roles of program 
evaluation are encompassed in the 
objectives of the Effort and Effects 
Evaluation and, to some extent, in 
the Organizational Impacts Evalua- 
tion. However, it is important to note 
a few ways in which internal evalua- 
tion demands imply unique objectives 
and information products. 

The implementation of organiza- 
tional strategy and policy occurs at 
several levels simultaneously. The 


structural implications of organiza- 
tional decisionmaking are discussed 
in the next section. For now, let us 
just say that administrative hier- 
archies create special demands for 
internal evaluation. The GAO-OOHD 
model designates Administrative 
Evaluation objectives to assist 
decisionmakers regarding resource 
distribution and, in some instances, 
to provide data which will help 
decisionmakers weed out failing 
efforts. This program monitoring 
function of evaluation in organiza- 
tions imposes a demand for infor- 
mation systems which cuts across 
program units and accumulates 
data in an ongoing fashion. 

The most significant role for 
internal evaluation is often described 
as the evaluation of organizational 
impact. After all, when the time 
comes to make a decision regarding 
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future commitments to action, the 
decisionmaker wants to know what 
worked for the organization, what 
did not work, and what will work. In 
the actual implementation of the 
GAO-OOHD model, each human 
resources program or project director 
would be able to provide some evi- 
dence of program effectiveness on 
the basis of the Effort and Effects 
Evaluation for his or her own area of 
responsibility. 

It is not acceptable, given current 
theories of organizational effective- 
ness, to assume that organizational 
impact could be determined by sum- 
ming up all these various individual 
evaluations. The evaluation of orga- 
nizational impact, rather, is inextric- 
ably tied to the organization’s theory 
of effectiveness. Therefore, the GAO- 
OOHD model gears the objectives of 
the Organizational Impacts Evalua- 
tion toward the measurement and 
projection of underlying assumptions 
about successful human resource 
management and development. 


Internal Evaluation 
and the Management 
Structure 


For an internal evaluation system 
to be useful and valid, it must fit the 


organizational context. Different 
levels of decisionmakers in the 
organization require different kinds 
of information. Top-level agency 
leadership requires broad-based 
and ‘“‘future-oriented” data on orga- 
nizational capabilities. Division- or 
office-level management probably 
requires a combination of administra- 
tive and program effectiveness data. 
Program directors and project leaders 
want to know the specific results of 
their efforts and possible ways to 
improve performance. The keys to 
implementing a comprehensive 
internal evaluation are the processes 
used for determining information 
needs and the system for gathering, 
processing, and disseminating the 
data. 

The effectiveness of a systematic 
approach to internal evaluation 
requires that information be useful to 
the various and key categories of de- 
cisionmakers. Generally, internal eval- 
uation addresses the requirements 
of three types of decisionmakers: 

1. Policymakers—those who 
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Outlining agency 
goals and needs 
for resources. 
Defining basic 
concepts in the 
relationships of 
the work force 
directions of 

the agency. 


Ranking HRD 
efforts according 
to agency 
objectives and 
goals. Allocat- 
ing HRD resources 
to HRD 
objectives. 
Applying criteria 
to quality 
control. 


Selecting “best” 
means to meet 
HRD goals. 
Allocating pro- 
gram resources 
to lines of 
effort. 
Adjusting re- 
sources and 
means to meet 
goals. 





Primary 
Evaluation 
Demand 


HRD impacts on 
agency objec- 
tives. 


Economy in allo- 
cations of HRD 
resources. 
Efficiency of 
HRD efforts. 
Compliance of 
HRM practices 
and/or efforts 
with judicial, 
legislative, 

and internal 
policy/quality 
standards. 


Effectiveness of 
program opera- 
tions in meeting 
program goals. 
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and process ana- 
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decide where the organization is 
going (strategy planning) and the 
rules for getting there (policy). 

2. Policy Administrators—those 
who structure the organization’s 
response to strategic goals and 
administer the organizational mech- 
anisms which maintain the desired 
response. 

3. Project/Program Managers— 
those who made organizational 
Objectives operable and manage 
production efforts. 

Figure 3 provides a simplified picture 
of the structure of managerial evalu- 
ation demand. 

Without going into detail concern- 
ing the match between the levels of 
managers and the types of evalua- 


tion information which are likely to 
be most useful, the point which is 
most important in implementing 
this concept of internal evaluation 
is the need to coordinate the de- 
mands of various decisionmaker 
audiences. Each manager has some 
unique information needs. But since 
managers often occupy several 
roles in the decisionmaking hier- 
archy, other information needs over- 


lap. In addition, managers are faced 
with both routine and ad hoc infor- 
mation demands. Therefore, to coor- 
dinate these diversified demands, a 
management information system 
must be able to handle data which 
is (a) program or activity specific, 
(b) comparable and collapsible 
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across program areas, (c) summable 
over time, and (d) accessible in eval- 
uative formats and arrays. With 
respect to the latter point, manage- 
ment information of an evaluative 
nature should include both indica- 
tors of the current conditions and 
indicators of the desired state 
which are criteria for judging the 
meaning of the current picture. 


The Role of the 
Internal Evaluator 


It is difficult to discuss the concept 
of internal evaluation without ad- 
dressing the role of the internal eval- 
uator. Granted, not all the evaluation 
functions discussed here require a 
specialist. However, it’s hard to con- 
ceive of a comprehensive function 
without a specially trained person(s) 
to implement the requisite systems 
and research projects. 

The relationship between the 
internal evaluator and _ decision- 
makers distinguish the internal eval- 
uator from the prototype external 
program evaluator. The essential 
characteristics of the internal evalu- 
ator’s role are revealed in the follow- 
ing quote (from the highly respected 
volume by Attkisson, et a/. (1978, 
p. 470)). 


There seems to be a growing 
consensus that evaluators make 
their most effective contribution 
when they are ongoing members of 
the decisionmaking team.... The 
need for ongoing, direct evaluator 
participation in all important admin- 
istrative levels implies that program 
evaluation resources are needed at 
each major administrative level. . . . 
Much current evaluation effort is 
still focused on one-time summative 
evaluations.... This distribution of 
effort does not match our current 
understanding of how to maximize the 
impact of evaluation. Evaluators must 
be close enough to the decisionmak- 
ing process to group clearly the needs 
and problems of management.... 


The role of internal evaluator 
demands not only technical skills 
and abilities, but, just as important, 
the ability to act as information 
manager. The internal evaluator 
must negotiate management de- 
mands for information and coordinate 
a system of response. 

This requirement has many impli- 
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cations for traditional notions of 
evaluation research design. Internal 
evaluators cannot treat the use of 
information as something that 
occurs after the evaluation work is 
done. Given the nature of most 
important organizational decisions, 
internal evaluators should be able 
to anticipate the form and timing of 
information before asking a ques- 
tion. In other words, the internal 
evaluator should be an active partic- 
ipant in planning activities and have 
the ability to structure routine and 
exceptional information strategies. 

In the final analysis, implementa- 
tion of a systematic internal evalua- 
tion will be judged successful or 
unsuccessful on the basis of the 
amount of useful information pro- 
duced. Fortunately, the most apparent 
solution to the problem of informa- 
tion overload or “informania” is 
simple. The more the evaluator 
knows about the nature of a man- 
ager’s decision, the better able that 
evaluator is to tailor feedback. Simi- 
larly, the more the manager knows 
up front about the nature of possible 
evaluation feedback, the more that 
manager can aid the evaluation 
process. 

The task of integrating evaluation 
into management decisionmaking 
processes requires a conscious and 
collaborating effort on the part of 
managers and evaluators. Managers 
are responsible for providing the 
type of information needed at the 
right time and in a useable format; 
the internal evaluators must demon- 
strate the usefulness of evaluation. 


Summary 


Because of the current emphasis 
on methods for improving manage- 
ment accountability and control in 
government and industry, the con- 
cept of internal evaluation is gaining 
popularity. But this concept requires 
clarification. The idea of using eval- 
uation tools to improve manage- 
ment effectiveness is valuable, but 
the implications of the concept are 
uncertain. 

In this paper, we have looked at the 
relationship between management 
decisionmaking and the concepts 
found in professional evaluation lit- 
erature. On the basis of previous 
work in the area, we have presented 
a tentative model (figure 1) to capture 


this integration. As we noted several 
times, the aims of internal evaluation 
require a sensitivity to the information 
demands of different management 
audiences. In turn, this requirement 
of responsiveness implies a system- 
atic approach to the development of 
evaluation models and procedures. 

Perhaps most important to the 
understanding of the concept of 
internal evaluation and to the devel- 
opment of a working model are the 
implications for managing informa- 
tion in a systematic approach to 
internal evaluation. The unique 
issues and problems identified in 
the discussion of these requirements 
have significant meaning for those 
who would assume the role of an 
internal evaluator. 
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GAO and the 
Accounting 
Profession 


Some of the important issues 
governments face in their attempts 
to improve financial management 
are challenging to the accounting 
profession. We in GAO have been 
involved in many efforts involving 
every aspect of government financial 
management: budgetary processes, 
accounting systems, financial 
reporting, and auditing. GAO believes 
more attention to the problems in 
each of these areas is urgently 
needed, especially in light of Presi- 
dent Reagan’s goal to pass more 
responsibility and authority to State 
and local governments through the 
New Federalism proposals and 
block grant legislation. 

If government is to satisfy the 
public’s expectation of greater 
accountability over public funds, 
especially with the shift in focus away 
from the Federal level, government 
financial management systems 
must be improved. The strong 
leadership and commitment of the 
accounting profession, along with 
the dedicated efforts of GAO, will be 
required if the improvements are to 
be made and if the public’s demand 
for efficient government operations 
is to be met. 


Status of 
Financial Management 
in Government Today 


The Budgetary Process 


The first process occurring in the 
government financial management 
cycle, and one in which improve- 
ments are critical, is the budgetary 
process. Combined Federal, State, 
and local budgets total nearly $1 tril- 
lion a year, a level of funding that 
has severely strained existing bud- 
getary processes. 

At the Federal level, the budget 
process has become extremely 
complicated and cumbersome. It is 
beset with severe timing problems, 
duplication, and an alarming increase 
in using continuing resolutions to 


finance Government operations. 
Even more disheartening are the 
delays in funding decisions, such as 
those which threatened to interrupt 
operations at the Department of 
Defense, the Internal Revenue Ser- 
vice, and even at GAO. 

This state of affairs is in no small 
measure the result of our budget 
process, which requires 13 appropri- 
ation bills to be passed each year to 
fund Federal Government opera- 
tions. When any of these bills does 
not pass, various Government agen- 
cies operate on what are termed 
continuing resolutions. Essentially, 
these resolutions permit agencies 
to continue spending at the prior 
year’s spending levels, but even 
these resolutions may not be 
passed. In any case, using continu- 
ing resolutions is not an efficient 
way to run acountry. For example, if 
the new fiscal year appropriation 
was to be increased or decreased, 
spending at a previous year’s level 
distorts what the Congress intends 
with the new appropriation. Lately, 
it seems the Congress is delaying 
its vote on more and more funding 
decisions—either appropriation 
bills or continuing resolutions—until 
agencies are threatened with shut- 
downs, or, as happened in November 
1981, until after some agencies 
actually do shut down. These delays 
not only affect the efficient and 
effective operation of Government 
programs, but also the financial 
markets and the economic stability 
of the country. 

The Federal budget process was 
last examined comprehensively in 
1967. Clearly, it is time for the 
Federal budget process to be 
overhauled. Such an effort requires 
creating a high-level budget study 
group or commission to act as a 
catalyst for badly needed changes in 
the Federal budgetary concepts and 
procedures. 

Meanwhile, the Congress is con- 
sidering changes in the Federal bud- 
get process. One of these changes 
is the establishment of a 2-year bud- 
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get cycle, which is a major provision 
of the proposed Budget Reform Act 
of 1982. In addition to this provision, 
the bill is designed to improve con- 
gressional control over the budget, 
streamline the requirements of the 
budget process, improve the legisla- 
tive and budgetary process by pro- 
viding additional time for oversight 
and other legislative activities, and 
provide stability and coherence for 
recipients of Federal funds. | recently 
testified before the Congress that 
enactment of this bill or some fea- 
tures of it will be an important first 
step toward bringing greater stability 
to our Government’s activities, and 
thus to our economy. 

By themselves, proposed changes 
to the Federal budgetary process 
can solve only some of the problems 
in Federal financial management. 
The other financial management 
processes and systems that support 
Federal policymaking—accounting 
and financial reporting, in particular— 
also need to be strengthened and 
integrated with the budgetary process 
to meet the needs of the Congress 
and the executive branch. 


Integrating Budget 
Processes and Accounting 
Systems 


Currently, decisionmakers in both 
the executive branch and the Con- 
gress have to cope with separate 
and sometimes uncoordinated bud- 
geting and accounting systems. 
These systems badly need to be 
integrated. One problem with non- 
integrated systems is their inability 
to tie expenditures to specific areas 
of concern. Budgets usually address 
significant areas of concern to the 
public, such as military readiness. 
The Federal accounting systems, 
however, are designed to track 
expenditures by type rather than by 
area of concern, so a direct relation- 
ship between funds expended and 
areas of concern is usually not pos- 
sible, and no assurance can be 
made that funds are expended as 
planned. 

An excellent example of this 
inefficient relationship between 
funds expended and areas of con- 
cern is contained in GAO's recent 
report on how the $72 billion increase 
between the fiscal 1980 and 1982 
Defense budgets was spent. The 


President requested the large in- 
crease, and the Congress passed it 
to improve military readiness, mod- 
ernize the forces, and improve the 
quality of life for military personnel. 
GAO’s examination at selected mili- 
tary bases showed that some of the 
readiness funds were used to buy 
and insert simulated redwood slats 
in a chain-link fence at one location 
and to build a new gatehouse, a visi- 
tors center, and a parking area at 
another. Obviously, the relationship 
between these expenses and military 
readiness is not apparent. 

As that same report demonstrates, 
separate systems inhibit effective 
communication between the execu- 
tive and legislative branches of Gov- 
ernment. Integrated systems, how- 
ever, can provide assurance that the 
budget is executed according to 
spending plans and that all funds 
are accounted for, including those 
provided to grantees. So, it is clear 
that the separate systems must be 
integrated, and | believe the account- 
ing profession is in an excellent 
position to help. 


Accounting Systems 


In addition to the improvements 
needed in government budgetary 
processes and in integrating these 
processes with accounting systems, 
the accounting systems them- 
selves—the second major area in 
the government financial manage- 
ment cycle—need to be improved. 
GAO is dedicated to improving the 
usefulness and the reliability of the 
information provided by Federal 
Government accounting systems. 

GAO’s reviews of accounting 
systems in operation have shown 
that many agencies maintain mar- 
ginal systems which neither function 
the way they are intended nor provide 
financial managers with the infor- 
mation they need to control and 
account for activities. Why? Because 
many of these systems are poorly 
designed, improperly implemented, 
or contain inadequate internal 
controls. 

GAO is required by law to review 
and approve the adequacy of Federal 
agencies’ accounting systems. GAO 
is currently studying its accounting 
systems work to see how agencies 
can be better encouraged to seek 
review and approval and to operate 


more effective and efficient account- 
ing systems. GAO is consulting with 
top financial managers within the 
Government, the public accounting 
profession, and academia to learn 
how we can improve our accounting 
systems approach. 

The 1929 stock market crash was 
the catalyst that forced improved 
accounting and financial reporting 
in the private sector. The 1975 New 
York City fiscal crisis did the same 
for the government sector and has 
prompted many State and local gov- 
ernments to make notable progress 
in developing sound accounting 
systems. Several States now have 
accounting systems that, in whole 
or in part, produce reports in accord- 
ance with generally accepted ac- 
counting principles (GAAP). Also, a 
number of other States, as well as 
local governments, such as New 
York City and the Nation’s Capital, 
have invested a great deal of time 
and money improving their account- 
ing systems. This area of accounting 
systems work presents one of the 
greatest opportunities for the ac- 
counting profession to contribute to 
improved government financial 
management. 

Internal controls are another area 
in which the accounting profession 
has a great deal of expertise and, 
therefore, can make a notable con- 
tribution to improved government 
accounting systems. One reason 
accounting systems do not function 
as well as intended is their lack of 
good internal controls. Adequate 
internal controls form the corner- 
stone of a good accounting system, 
but only recently have they begun to 
receive the attention they rightfully 
have deserved for so long. 

Even though effective internal 
controls have been mandated by 
law for Federal agencies for over 
30 years, the ever-increasing disclo- 
sures of fraudulent activities and 
ineffective financial procedures 
existing in many agencies demon- 
strate the inadequacy of many of 
the internal controls. GAO, as well 
as many other organizations through- 
out the accounting profession, feel 
that this situation will improve sub- 
stantially soon as a result of the 
recently passed Federal Managers’ 
Financial Integrity Act of 1982. We 
testified in support of this legisla- 
tion, as did the AICPA, and the 
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Association of Government Accoun- 
tants. Also, the firm of Price Water- 
house & Co. played a very active role 
in developing the legislation. 

The legislation requires ongoing 
evaluations of internal accounting 
and administrative control systems 
of each executive agency. These 
evaluations, conducted according 
to OMB guidelines, will determine 
whether the agencies’ internal con- 
trol systems comply with standards 
to be set by the Comptroller General. 
The legislation calls for an annual 
statement, signed by the agency 
head, attesting to the effectiveness 
of the agency’s internal controls. It 
also calls for outlining—if neces- 
sary—a plan and timetable for 
strengthening any weaknesses 
found in the controls. 

To carry out GAO’s responsibility 
under the act, | have established a 
task force in GAO on internal con- 
trols. Its task will be to consolidate 
GAO’s numerous publications stat- 
ing its policy and standards on inter- 
nal controls into a single document. 
As part of this project, we are con- 
sulting with various public account- 
ing firms to discuss their views on 
internal control standards. We 
expect to publish this document by 
the end of this year. 

Inspectors general also will play a 
significant role in implementing the 
legislation because of their continu- 
ing responsibility for assessing 
agency accounting and administra- 
tive control systems. Before the first 
Office of Inspector General was cre- 
ated in 1976 at the Department of 
Health, Education, and Welfare, the 
Federal agency audit functions 
were relatively weak. Even agencies’ 
assessments of their own account- 
ing and administrative control sys- 
tems were not as strong as they 
could be. Since then, however, the 
creation of 18 statutory Offices of 
Inspector General has significantly 
changed the organizational place- 
ment and the activities and respon- 
sibilities of Federal agency audit 
operations. We expect these assess- 
ments of internal control systems 
(as required by the Federal Man- 
agers’ Financial Integrity Act of 
1982) will contribute greatly to im- 
proving internal controls in the Fed- 
eral Government. 

State and local governments are 
also beginning to place a high prior- 
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ity on internal controls. With the 
new Federalism proposals, internal 
controls at these levels will become 
even more important. At least two 
States—California and New York— 
are following the Federal Govern- 
ment’s example and are considering 
legislation similar to the Federal 
Managers’ Financial Integrity Act of 
1982. 


Financial Reporting 


Financial reporting is the third 
major area in the government finan- 
cial management cycle needing the 
attention of the profession. Sound 
financial reporting is the major 
means public officials use to review 
their operations and communicate 
their accountability to the public. To 
be effective, financial reporting 
must be based on accepted account- 
ing principles and standards. In gen- 
eral, government efforts to establish 
effective and efficient accounting 
principles and standards have 
lagged behind private industry’s. 

The GASB, which is proposed to 
set accounting principles and stan- 
dards for the State and local govern- 
ments, is about to be formed after 
three years of work and dedication by 
several individuals and organizations 
in the accounting profession. The 
principal organizations—including 
GAO; AICPA; the Financial Account- 
ing Foundation; the Municipal 
Finance Officers Association; the 
National Association of State Audi- 
tors, Comptrollers, and Treasurers; 
and the National Council on Govern- 
mental Accounting—have agreed 
on the final proposal for the GASB 
and returned it to their executive 
boards for endorsement. Also, the 
seven public interest groups 
involved in the GASB formation are 
currently considering endorsement 
of it. As it is now envisioned, the 
GASB will be equal to the FASB 
under the Financial Accounting 
Foundation. It will have a full-time 
chair and a part-time board, an 
annual operating budget of approxi- 
mately $1 to $2 million, and will be 
based in Stamford, Connecticut. It 
will be very important that all organi- 
zations concerned with State and 
local governmental accounting and 
reporting support the GASB, once it 
is formed. 

| hope that State and local govern- 


GAO and the Accounting Profession 


ments will follow the same policy 
GAO intends to, that is, that they 
will adopt as many of the GASB and 
FASB standards as possible. In this 
way | think government accounting 
will become more useful and more 
understandable to the outside world. 


Auditing 


Auditing is the fourth major area 
in which the profession can help 
bring about needed improvements 
in government financial manage- 
ment. Improvements in budgeting, 
accounting, and financial reporting 
will be ineffective without assurance 
that the financial systems are work- 
ing properly and that full disclosure 
of results will be made at all levels 
of government. This assurance can 
be provided through the audit proc- 
ess, but only if improvements are 
made in that process. 

This need for improvements was 
discussed in a 1979 GAO report. 
According to that report, many Fed- 
eral grants (totaling about $90 billion) 
are not audited, and substantial 
duplication often occurs when indi- 
vidual grants are audited. This infor- 
mation illustrates the critical need 
to improve audit coverage and to 
make the audits more cost effective. 

GAO supports the single audit 
concept as an approach that can 
increase audit coverage while it 
streamlines the audit process. This 
concept will change the focus of 
audits from the individual Federal 
grant recipients to the operating 
entity at the State or local level. It 
emphasizes a review of entire finan- 
cial management systems—including 
the internal control systems—that 
monitor grants. The single audit 
concept also provides an improved 
audit base for performing additional 
selective compliance, economy and 
efficiency, and program results 
audits to satisfy specific Federal, 
State, and local user needs. 


The Accounting 
Profession’s Help 

Is Needed To Bring 
About Changes 

in Government 
Financial Management 


| have discussed many improve- 
ments needed in the government 
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financial management cycle. These 
improvements cannot be made with- 
out the dedicated efforts of the 
accounting profession working with 
governments at all levels. Many 
firms probably are involved in pro- 
viding professional services to gov- 
ernments or will soon be involved 
because of the big push toward 
improved accounting systems and 
audited financial statements. When 
providing these services, these 
firms are in an excellent position to 
greatly improve government account- 
ing by designing effective systems 
that can be audited efficiently, pos- 
sess strong controls, and produce 
GAAP financial reports. 

The attention finally being placed 
on internal controls, especially as 
evidenced by the recent passage of 
the Federal Managers’ Financial 
Integrity Act of 1982, is an important 
step toward improving the Federal 
Government’s financial management 
systems and procedures. Several 
efforts are underway to study what 
other measures can be taken to 
bring about improvements. For 
example, the President’s Private 
Sector Survey on Cost Control is 
studying many of the problems | 
have discussed here. In addition, 
the Reagan Administration is under- 
taking a multiphased management 
effort which will address Federal 
budget and financial management 
systems. 


The fact that these studies are 
ongoing shows the high level of 
interest in improving government 
financial management. When devel- 
oping their proposals for the needed 
improvements, these groups should 
consider several items. In addition 
to a streamlined budget process 
and an integration of budget, ac- 
counting, and other supporting sys- 
tems, these items include 


* consolidating the Federal Govern- 
ment’s accounting into several major 
accounting and finance centers; 

e establishing qualified Chief 
Financial Officers at each major 
agency in the Federal Government 
with strong, well-qualified staffs to 
support them; 

e establishing a stronger central 
financial management function in 
the executive branch that would be 
responsible for keeping the central 


books of account; 

e continuing to develop consolidated 
financial statements for the Federal 
Government, which will require 
good accounting at the agency 
accounting and finance centers and 
the proper flow of information to the 
central accounting function; 

e continuing to have accounting 
standards established by and ac- 
counting systems approved by GAO; 
and 

e performing—in the long run—an 
annual financial audit of the Federal 
Government. 


lf these improvements are made 
to the Federal Government’s finan- 
cial management systems, | believe 
an annual financial audit of the Fed- 
eral Government might be both 
desirable and economical. If we 
could ever have 10 to 15 major ac- 
counting and financial centers oper- 
ating on a standard system according 
to Comptroller General accounting 
standards and a proper flow of 
financial data to a central account- 
ing function, then we might be ready 
to have an annual audit of the finan- 
cial records and statements of the 
Federal Government. As | have men- 
tioned, many of our larger cities and 
counties have moved toward an 
annual audit and improved account- 
ing systems since 1975. Several of 
the States are now moving in that 
direction. Soon, people will ask, 
“Why not the Federal Government?” 

However, | do not believe that we 
should embark on an annual audit 
until we know it can be done effi- 
ciently. These improvements will 
require a substantial investment in 
personnel and systems. And sup- 
port at the highest levels of govern- 
ment will be vital. With this support, 
we will ultimately achieve what we 
all want—improved financial man- 
agement in the Federal Government. 


Finally, one of the most important 
steps | believe the profession must 
take to help bring about needed 
improvements is to encourage 
more of its members to apply their 
skills in the government arena. 
Other professions, such as law and 
investment banking, have placed 
many more people in government 
than the accounting profession. 
One recent effort to help public 
accountants enter the Federal Gov- 


ernment is the AICPA’s publication 
entitled ‘‘Federal Conflict-of-Interest 
Laws as Applied to Government Ser- 
vice by Partners and Employees of 
Accounting Firms.” This publication, 
developed by the Washington Office 
of the AICPA, explains the conflict- 
of-interest laws so that members of 
the profession will know the precise 
scope and limitations of the laws 
and the steps they must take to 
comply with them. We need more 
such efforts to increase the opportu- 
nities and attractiveness of Govern- 
ment service to members of our 
profession. 


* * * * 


| believe the accounting profession 
has been making notable contribu- 
tions in government financial man- 
agement for some time now. But 
now more than ever, we must con- 
tinue to work diligently together. 
Such efforts as the possible review 
of the financial management of the 
Federal Government, the commit- 
tees and conferences at which the 
accounting profession and GAO are 
working together on government 
financial management, and changes 
that are already taking place at the 
State and local level will go a long 
way toward improving government 
financial management. 

With the public’s ever-increasing 
demand for governmental account- 
ability and with the administration's 
shift in emphasis from the Federal 
to other levels of government, it is 
extremely important that improve- 
ments not only continue to be made, 
but also continue with the full involve- 
ment of the accounting profession. 
We can make the improvements 
that our profession envisions and 
can meet the public’s demand for 
better accountability only if we con- 
tinue to work together with a strong 
sense of commitment and dedication 
toward a common goal: effective 
and efficient government financial 
management. 





Abbreviations 


AICPA-American Institute of Certified 
Public Accountants 

GASB-Government Accounting Stand- 
ards Board 

FASB-Financial Accounting Standards 
Board 
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Relocating Witnesses: 
Necessary But 
Administratively 


Difficult 


Witnesses are crucial to the 
successful prosecution of any type 
of organized criminal activity. No 
matter how sophisticated Federal 
investigative techniques become, 
nearly all criminal trials turn on the 
testimony of an individual who can 
say ‘| saw him do that” or “I was 
with him when he did that.” However, 
the fear of reprisal or retaliation has 
deterred many potential witnesses 
from testifying. This led to the crea- 
tion in 1970 of a formalized program 
to protect witnesses, the Witness 
Security Program. 

While the basic concept of the 
Witness Security Program—relocat- 
ing a witness and his or her family 
and providing them with new identi- 
ties—is fairly uncomplicated, its 
implementation and administration 
has been anything but easy. In pros- 
ecuting high-profile criminals, the 
Government rarely finds witnesses 
who are innocent bystanders at the 
commission of a crime. Rather, 
prosecution witnesses are usually 
found within the criminal organiza- 
tion and are integrally involved in 
crime themselves. Thus, to gain suc- 
cessful prosecutions in some cases, 
the Government may have to, in 
essence, “make a deal with the 
devil.” 

The very people the Government 
is forced to deal with have created 
most of the administrative problems 
that have beset the program. GAO 
recently issued a report that looks 
at some of these problems and 
made recommendations to correct 
them. 


Background 


Prosecutors and law enforcement 
agents have long recognized that 
witnesses who testified against cer- 
tain individuals did so at serious 
risk to themselves and their families. 
The Kefauver Committee found in 


the 1950’s that a major organized 
crime syndicate 


... Will eliminate anyone who stands 
in the way of its success and destroy 
anyone who betrays its secrets and 
will use any means available, includ- 
ing intimidation, to defeat any 
attempt by law enforcement to inter- 
fere with its operation. 


Before the existence of a formalized 
protection program, witnesses were 
protected on anad hoc basis. Police 
officers, investigative agents, and 
prosecutors periodically aided wit- 
nesses whose cooperation with the 
Government placed them in jeopardy. 
The assistance varied and included 
arrangements for relocating to a 
new residence, establishing a new 
identity, or obtaining employment. 
Often, the assistance was little 
more than a bus ticket to some 
distant location. 

In the late 1960’s, the Congress 
became increasingly concerned 
about the increased influx of ‘“‘orga- 
nized crime” into both illegal and 
legal segments of society. Congres- 
sional hearings again disclosed that 
organized crime groups were known 
to have murdered, tortured, and 
threatened witnesses. Law enforce- 
ment officials testified that this situa- 
tion was hampering prosecutions and 
deterring witnesses from cooperat- 
ing with law enforcement agencies. 

Congressional hearings in the 
1960’s led to the passage of the 
Organized Crime Control Act of 
1970. The purpose of the act was to 
eradicate organized crime by strength- 
ening the legal tools used in gathering 
evidence. Title V of the act autho- 
rized the Attorney General to provide 
security to persons—and their 
families—intended to be called as 
Government witnesses in proceed- 
ings against organized crime activity. 
Thus, the Witness Security Program 
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was born. The Marshals Service, a 
bureau of the Justice Department, 
was given responsibility for the 
program. 

The types of cases investigated 
and prosecuted with the assistance 
of the Witness Security Program 
have changed over the years. Ini- 
tially, the program was intended to 
protect witnesses testifying against 
persons allegedly engaged in “La 
Cosa Nostra” activity. As time 
passed, however, the number of wit- 
nesses sponsored by other depart- 
mental units increased, and the 
prosecutive priorities of the Depart- 
ment changed, resulting in emphasis 
on other types of crimes. For in- 
stance, relocated witnesses have 
been used to prosecute public offi- 
cials in the FBI’s “Abscam” investi- 
gation and in attempts to prosecute 
members of motorcycle and prison 
gangs. Overall, more than 4,000 wit- 
nesses have been admitted to the 
program since 1970. 

The basic mechanism used to 
protect witnesses has also changed 
since the program’s inception. At 
first, witnesses were protected in 
“safehouses” (secured facilities) 
where they were provided with 
round-the-clock protection by deputy 
marshals. Experience showed, how- 
ever, that safehouses were not well 
suited to the realities of protecting 
individuals for several reasons: the 
location of safehouses was often 
inadvertently disclosed, they were 
unappealing for individuals not 
under a jail sentence or who had 
families, and they were not compat- 
ible with the long-term assimilation 
of witnesses back into society. 
Because of the necessary 24-hour 
protection, they also were becoming 
prohibitively expensive to operate. 
For these reasons, the safehouse 
approach was abandoned. 

The Marshals Service now provides 
protection by giving witnesses new 
identities with supporting documen- 
tation, such as a birth certificate 
and social security card. It also relo- 
cates them to areas free from the 
criminal element they testified 
against and provides them with a 
temporary living subsistence until 
they can achieve self-sufficiency. 
The Marshals Service conceals the 
new identity and location of a wit- 
ness. The Marshals Service also 
arranges for other types of social 
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services, such as employment 
assistance, resumé preparation, 
emergency medical treatment, and 
drug rehabilitation services. This is 
done to help the witness become 
successfully established in his or 
her new community as a law-abiding 
citizen. 

Because of the types of persons 
who enter the program, however, the 
Marshals Service’s relocation task 
has proven difficult. Many witnesses 
do not make successful adjustments 
into their new communities. Relo- 
cated witnesses frequently have 
failed to satisfy civil obligations, 
and some have been convicted of 
serious crimes. 


The “Gamble’”’ 
Sometimes Fails 


Several factors make the Witness 
Security Program difficult to admin- 
ister and hinder the chances that 
relocated witnesses will successfully 
establish themselves in their new 
communities. First, the program’s 
basic operating concept—relocation 
under a new identity while leaving 
behind all previous ties—is trau- 
matic. Further, inherent conflicts 
exist in this concept. Although wit- 
nesses are assisted in finding em- 
ployment, verifiable employment 
references cannot be given as this 
would conflict with the goal of con- 
cealing a witness’ identity and loca- 
tion. The Marshals Service’s job is 
complicated further by the fact that 
most relocated witnesses have 
criminal backgrounds, limited edu- 
cation, and often lack marketable 
job skills. 

The trauma derives from the basic 
method of providing protection. 
Relocating and changing the names 
of persons forces them to totally 
restructure their lives. Under the 
program, witnesses and their fam- 
ilies must break all direct contact 
with nonrelocated family members, 
past friends, and associates. In 
some instances, relocation must 
occur literally within hours to protect 
the life of a witness. Any subsequent 
communication by a witness with 
friends from the “danger area” can 
only be made in a secure manner, 
such as through the use of an anon- 
ymous post office box. The trauma 
of relocation is compounded because 
witnesses must often be evasive 


about their pasts in the course of 
establishing friendships and busi- 
ness associations in their new loca- 
tions. Adding to that trauma is the 
never-ending fear that someone 
from their past might recognize 
them and cause them harm. As 
would be expected, many witnesses 
cannot cope with this drastic life- 
style change and have voluntarily 
returned to their “danger area” 
despite the threat to their lives. A 
handful have died as a result of this 
decision. One witness was blown up 
when he opened the front door of his 
residence after he returned to the 
“danger area.” 

Inherent conflicts also exist in 
basic program goals. The need to 
keep a witness’ new identity and 
location secret creates problems in 
helping a witness establish a new 
life. For example, witnesses must 
attempt to find work in their new 
locations. However, to protect their 
identities, they cannot provide pro- 
spective employers with any verifiable 
employment references. If such ref- 
erences were provided and checked, 
a link between the witnesses’ past 
and their new identities could be 
established. Similar problems are 
encountered when witnesses attempt 
to establish credit in their relocation 
area. 

Obviously, the program would be 
difficult for the Marshals Service to 
administer under the best of circum- 
stances. However, the Marshals Ser- 
vice usually does not encounter the 
best circumstances. An estimated 
95 percent of the persons admitted 
to the Witness Security Program 
have prior criminal backgrounds. 
This creates additional problems in 
obtaining jobs for witnesses because 
the Marshals Service is obliged to 
disclose the general nature of a wit- 
ness’ criminal background to pro- 
spective employers. The criminal 
nature of witnesses also requires 
the Marshals Service to be especially 
careful in its assistance efforts. 
Marshals Service officials have 
stated that one reason they do not 
give a witness extensive background 
documentation is the potential 
liability the Government would incur 
if the documentation is used for 
fraudulent purposes. 

Finally, the Marshals Service’s 
efforts to assist a witness in obtain- 
ing employment are complicated by 
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the fact that witnesses often have 
limited marketable job skills and/or 
limited education. Education and 
job skill information for witnesses 
admitted to the program during fis- 
cal year 1981 showed that 59.2 per- 
cent of their reported labor skills 
were of an unskilled nature and 
34.2 percent of the witnesses did not 
complete high school. In comparison, 
Bureau of the Census educational 
data indicates that, in comparable 
age groups, 20.3 percent of the 
Nation’s population did not com- 
plete high school. During December 
1980 congressional hearings, a Fed- 
eral prosecutor who personally 
sponsored the admission of about 
20 witnesses into the program 
summed up the problem they face: 


The witness, however, has never 
worked a day in his life at an honest 
job. His prospects for finding gainful 
employment are less than realistic. 
We would be naive to assume that 
we can take a hardened criminal out 
of one city, put him in another, and 
then ask him not to engage in crimi- 
nal acts, but to be content as a 
sanitation worker. 


Consequently, each use of the 
Witness Security Program actually 
constitutes a “gamble” as to whether 
relocated witnesses will be able to 
adjust to their lives and become law- 
abiding citizens under their new 
identities. Witnesses do not always 
achieve this goal. In reviewing many 
different types of program-related 
information, it is not uncommon to 
find instances where witnesses had 
failed to satisfy their debts or had 
committed crimes, some of an 
extremely violent nature. 


Civil Problems 
Caused by Witnesses 


Longstanding problems encoun- 
tered in the Witness Security Pro- 
gram are that witnesses have ignored 
their civil oblilgations and innocent 
citizens often have had difficulty in 
enforcing court judgments against 
witnesses. Our work showed that 


Separated or divorced parents who 
were not in the program have encoun- 
tered hardships trying to enforce 
their legally established parental 
rights against the other parent, who 
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is relocated in the program with a 
minor child or children, and credi- 
tors have suffered financially 
because they were hindered in their 
ability to enforce judgments and 
collect debts from witnesses. 


The civil problems experienced 
with the program do not result simply 
because witnesses owe money, nor 
do they result from the fact that the 
debtors are relocated witnesses. 
The problems occur because of a 
dilemma the Justice Department 
faces when witnesses ignore court 
judgments and fail to repay their 
lawful obligations: How does the 
agency protect a witness’ secret 
new identity (and thus their safety) 
while assisting an injured party in 
enforcing a judgment against a 
witness? 

The case of Thomas Leonhard 
has been the most celebrated case 
of a nonrelocated parent attempting 
to enforce parental rights against 
the parent in the program. Twice 
Mr. Leonhard has lost lawsuits at 
the Federal appellate level. His 
plight was portrayed in Hide in Plain 
Sight, a 1976 book by Leslie Waller, 
and in a recent movie by the same 
name. For 8 years, Thomas Leonhard 
unsuccessfully attempted to get the 
Government to tell him where his 
children (living with his ex-wife and 
a witness) had been relocated so 
that he could enforce his court- 
ordered visitation rights. 

Another case that is currently 
being litigated in Federal appeals 
court is that of William Franz. From 
1974 to 1978, Mr. Franz regularly vis- 
ited his three children. However, in 
February 1978, Franz’s chiidren and 
ex-wife were suddenly relocated 
with a Government witness, a self- 
admitted organized crime enforcer. 
Mr. Franz was not told about the 
relocation. Since that time, he has 
been attempting, to no avail, to see 
his children. Because the Govern- 
ment maintains it has a duty to pro- 
tect the security of the witness and 
his family, it will not reveal their 
location to Mr. Franz. This prevents 
Mr. Franz from going before an 
appropriate court to seek legal 
assistance to enforce his parental 
rights. 

A less emotional but more frequent 
problem occurs when witnesses 
don’t pay their lawful debts. A recent 
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example that demonstrates this 
point is the case of Peter Aver. 

Aver was admitted to the Witness 
Security Program in October 1978 
because he testified in the prosecu- 
tion of two men in Boston accused 
of murdering four others in what 
became known as the “Blackfriars’ 
Massacre.” Because of his testi- 
mony, Aver was given a new name 
and relocated to Huntsville, Alabama. 
However, he left in Boston many 
creditors who to date have been 
unsuccessful in collecting monies 
allegedly owed them by Aver. 

After a short stay in Huntsville, 
Aver relocated himself (without 
Government assistance) to Jack- 
sonville, Florida, where he became 
involved shortly thereafter as an 
undercover operative in the FBI’s 
“Resfix” sting operation. However, 
Aver left a woman in Huntsville hold- 
ing a court judgment (worth over 
$100,000 in property and money) 
against him. This woman is still 
attempting to enforce this judgment 
(now over 2 years old) against Aver. 
Aver, who reportedly has been given 
yet another new identity, is currently 
in Federal custody after being con- 
victed in Florida of passing bad 
checks and after being convicted of 
Federal wire fraud charges. 

While certainly representing an 
extreme, the difficulties caused by 
Mr. Aver unfortunately do not repre- 
sent an isolated example of this 
type of problem. During congres- 
sional hearings in December 1980, a 
Marshals Service official testified 
that 35 letters a month are answered 
from creditors or other persons 
alleging they have been defrauded by 
witnesses. In GAO’s review, we found 
that, during a 6-month period in cal- 
endar year 1980, 36 witnesses owed 
or allegedly owed over $7.3 million. 

The types of persons to whom 
these debts were owed varied from 
private individuals to large com- 
panies and to the Government itself. 
There were doctors seeking to 
recover money for services rendered, 
nonrelocated parents seeking to 
collect child support, a woman 
seeking to recover a personal loan, 
a stock brokerage firm seeking to 
recover money from a former em- 
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Measuring Student 
Academic Progress: 


A Case Study 


e Aprivate, 4-year college requires 
students receiving Federal aid to 
attain a minimum grade point aver- 
age of 0.5 (an “F-plus”) on a 4.0 scale 
by the end of the first year. The 
requirement increases with each 
successive year, with a 2.0 required 
for graduation. Because of these 
low standards, more than 40 percent 
of the students on aid have averages 
below 2.0, and more than 20 percent 
have averages below 1.5 (a “D-plus’”’). 

e A student at a community 
college receives more than $9,000 in 
Federal aid over a 4-year period, 
completing only 60 of 108 credit 
hours attempted and never attaining 
a grade point average sufficient to 
graduate. She attempts five courses 
three times each and two other 
courses twice each, with only the 
last grades received included in her 
grade point average. 

e A student at another community 
college obtains an associate degree 
in nursing, assisted by more than 
$5,000 in Federal aid. After obtaining 
this degree, she remains in school 
for two more quarters, receiving an 
additional $2,000 in aid to pursue 
such general interest courses as 
automotive electric systems, archi- 
tecture construction, beginning 
snow Skiing, and yoga. 


Shocking? Certainly. Flagrant 
disregard for Federal requirements? 
Not at all. In fact, the above examples 
fall perfectly within the parameters 
set for the appropriate Federal stu- 
dent aid programs. And therein lies 
the problem. 

In a recent review of academic 
progress standards for students 
receiving Federal aid, we found 
case after case of students who had 
received thousands of dollars in aid 
without demonstrating the desire or 
potential to complete their programs 
of study. While examples such as 
those above were not exactly typical, 
they did occur with enough fre- 
quency to point to an underlying 
weakness in Federal requirements. 


Our work in this area presents an 
interesting case study for program 
evaluators because it shows the 
complexities of administering and 
evaluating student aid where the 
Government, students, institutions 
of higher education, and other orga- 
nizations form a unique partnership. 
It is an area of immense complexity, 
where right and wrong often depend 
on one’s perspective and where cir- 
cumstances are heavily influenced 
by a set of constantly changing vari- 
ables. A full understanding of the 
issues requires first an understand- 
ing of the many diverse elements 
that make student aid work, then an 
appreciation for the difficulties in 
setting and enforcing Federal require- 
ments in an area where academic 
freedom is paramount. 


A College Education: 
The Dream 
Becomes Reality 


A college education has long 
been an integral part of the American 
Dream. Parents coming out of the 
long, hard years of the Depression 
and two world wars saw education 
for their children as a solid start 
toward a better life than they them- 
selves had known. For some, college 
was only one of many stops on the 
way up. For others, it was a ticket 
out of a life of poverty and missed 
opportunities. For still others, a col- 
lege degree was an end in itself, sig- 
nifying that a person had ‘made it.” 

And yet, all too often, a college 
education was the exclusive privilege 
of the advantaged. Always available 
to the well-to-do, college remained 
only a dream to many from middle- 
and lower-income families where 
the financial resources to make it 
happen simply did not exist. There 
were always the oft-cited examples 
of the poor but brilliant and hard- 
working types who received scholar- 
ships or worked their way through 
school but, for most, money remained 
a huge and often insurmountable 
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obstacle. 

Federal support to students in 
higher education goes back many 
years. Among the earliest and most 
popular forms of support was the 
G.I. Bill, which enabled thousands 
of veterans to go to college. Aidona 
broad-based level did not really 
begin until the late 1950’s, however, 
when the National Defense Student 
Loan program began a trickle of aid 
that was later to become a torrent. 
With passage of the Higher Educa- 
tion Act in 1965, student aid for the 
economically disadvantaged 
became a major national objective, 
and Federal funds available for this 
purpose began to mushroom. 

Today, student aid is big business 
on college campuses. It is an indus- 
try in itself, employing thousands of 
professional personnel who spend 
years mastering the intricacies of 
packaging aid for students and 
administering the requirements of 
the various programs. Student aid is 
now available through a myriad of 
programs, offering benefits to stu- 
dents from middle-income families 
as well as the economically disad- 
vantaged. Also, aid is available to 
students seeking technical training 
beyond the high school level as well 
as those enrolled in traditional col- 
leges and universities. 

Despite this increased availability, 
many problems in providing aid to 
those who need it still exist. Many 
students, for example, find that the 
amounts of aid available are not 
always a match for the skyrocketing 
costs of a postsecondary education. 
And recently, there has been consid- 
erable discussion on cutbacks in 
Federal aid, or at least in redistribut- 
ing it among programs. Also, there 
is the problem of administering the 
billions of dollars distributed among 
thousands of institutions and mil- 
lions of students to ensure that 
abuse is not taking place. 


Sources of 
Student Aid 


Literally dozens of Federal pro- 
grams offer financial assistance to 
students enrolled in postsecondary 
educational institutions. Some are 
well known and offer benefits to 
thousands of students from all 
social and economic strata; others 
are severely restricted in their 
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scope, aimed at relatively small 
numbers of students in specific tar- 
get groups. Some offer benefits that 
are not even known to the vast 
majority of people. 

In recent years, however, three 
providers of funding have stood out 
as being the largest sources of Fed- 
eral student aid: the Department of 
Education (ED), the Veterans Admin- 
istration (VA), and the Social Security 
Administration (SSA). In 1980, these 
agencies provided more than $9.1 bil- 
lion in direct aid, and were respon- 
sible for billions more through loan 
guarantees and matching funds. 

The largest single source of 
student aid is ED, which offers 
assistance to postsecondary stu- 
dents under five major programs. 
These are the Pell Grant, an entitle- 
ment program for students who 
meet certain low-income and cost- 
of-school requirements; the National 
Direct Student Loan, Supplemental 
Educational Opportunity Grant, and 
College Work-Study Program, all 
administered directly by participat- 
ing schools; and the Guaranteed 
Student Loan, available from com- 
mercial sources to qualifying stu- 
dents. In total, these programs were 
responsible for about $9.2 billion in 
aid in fiscal year 1980, with an actual 
Federal outlay of about $5.3 billion. 

A second major source of student 
benefits is VA, which provides edu- 
cational benefits to veterans and 
certain dependents. In fiscal year 
1980, VA benefits totaled about 
$2.3 billion. 

Finally, social security benefits 
are available to the children of 
deceased, disabled, or retired con- 
tributors. To be eligible, the child 
must be unmarried, under 22 years 
of age, and attending a postsecond- 
ary institution full time. This program 
is now being phased out, with the 
last benefits to be paid in fiscal year 
1984, but in fiscal year 1980, benefits 
to postsecondary students totaled 
$1.6 billion. 

In our review of academic progress 
standards, we focused on benefits 
provided by these three agencies. 
The primary reason for this focus is 
obvious: the bulk of the money avail- 
able is concentrated in these pro- 
grams. Other reasons, however, 
made them attractive for an evalua- 
tion of this type. First, schools can 
usually identify the students receiv- 
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ing aid from these three sources, 
although this is not always the case 
in smaller programs. Second, there 
is sufficient contrast among the 
requirements in each program to 
make some general evaluations of 
their effectiveness. Third, there are 
considerable differences in the 
manner in which the three agencies 
administer the programs. VA is 
heavily involved in monitoring 
school and student performance; 
ED, to a much lesser extent; and 
SSA, practically not at all. 


What Is 
Academic Progress? 


Although not always specifically 
defined, an undergirding principle of 
student financial aid is that a recipi- 
ent should make satisfactory aca- 
demic progress. Requirements vary, 
but the general aim is to ensure that 
a student is moving toward an edu- 
cational goal at a reasonable rate 
while making acceptable grades. 
Simply stated, a student should be 
able to prove he or she has the 
desire and the ability to use public 
funds for the purpose intended. Thus, 
with the right comes a responsibility. 

What is academic progress? This 
question is largely unanswerable 
because of the many variables 
involved. Like beauty, progress is 
often in the eyes of the beholder. 
What constitutes acceptable prog- 
ress at one school might get a stu- 
dent suspended at another. Certainly 
a school has the right to some flex- 
ibility in setting academic standards, 
since the aid recipient is first and 
foremost a student at that institu- 
tion. At the same time, however, the 
public interest must be protected by 
ensuring that the limited supply of 
aid is not abused by students unwill- 
ing or unable to meet minimum 
levels of performance. Another ele- 
ment often overlooked is the respon- 
sibility to the student, who should 
be encouraged to seek that program 
best suited to his or her abilities and 
interests. 

The three agencies providing the 
bulk of student aid have treated the 
problem of determining academic 
progress in completely different 
ways. VA, with the most rigid Federal 
requirements, requires that a school 
must have an approved standard 
meeting certain specific criteria. In 
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addition, it requires that a student 
be enrolled in an approved course of 
study, have a specific objective, and 
make progress toward that objective. 
A major provision of the VA require- 
ment is that students can be paid 
only for courses leading to program 
completion. 

Requirements for ED programs 
are considerably more lenient. 
Schools must establish standards 
for academic progress but receive 
no guidance on what these stan- 
dards should include. 

The SSA program has no require- 
ments for academic progress. As 
long as an eligible student can stay 
in school full time, he or she can 
continue to receive benefits. Unlike 
the VA and ED programs, the SSA 
program does not even have an aca- 
demic progress requirement in its 
authorizing legislation. 


Selecting Institutions 
for Visits 


Choosing a representative group 
of institutions for site visits in evalu- 
ating student aid programs is a for- 
midable, if not impossible, task. The 
sheer number of schools, with more 
than 7,700 participating in ED’s Pell 
Grant program alone, is the first 
problem. Couple that problem with 
the fact that no two institutions are 
alike. There are 2-year schools and 
4-year schools, public schools and 
private schools, and proprietary 
schools. Institutions may vary in 
size from 100 or so students to more 
than 50,000. Admissions standards 
range from those which are open to 
virtually anyone who applies to 
those which take only a few of the 
most highly qualified applicants. 
The variations of academic stan- 
dards, curricula, and course offerings 
are endless. 


GAO Findings: 
Standards Too Low 


Our analysis of transcripts and aid 
records at the schools visited con- 
firmed the findings of previous GAO 
work in the area: many students 
receiving Federal student aid were 
not making real academic progress. 
This is not to say that either schools 
or students were not following 
established standards because, for 
the most part, they were. The real 
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problem was that the schools often 
set their standards too low or failed to 
consider all the elements necessary 
to measure progress. The cause: 
inadequate Federal requirements. 

Overall, VA students typically 
made better progress than students 
receiving ED or SSA benefits. Al- 
though only one factor of numerous 
probable factors which led to this 
result of better progress, VA required 
much more of both schools and stu- 
dents in establishing, enforcing, 
and complying with academic prog- 
ress standards. 

As noted earlier, there is no one 
magic formula for determining aca- 
demic progress. In closely evaluating 
the Federal requirements and the 
standards of the 20 institutions 
GAO visited, however, we eventually 
isolated those factors which affect 
the measurement of progress and 
which we believe must be consid- 
ered in establishing a standard. 
These factors include such items as 
minimally acceptable grade point 
averages, an equitable policy on 
awarding nonpunitive grades, and a 
rate-of-progress requirement to 
ensure a student moves through a 
program at a reasonable pace. 

The most popular and most nearly 
standardized method for measuring 
academic progress is the grade 
point average (GPA). Schools nor- 
mally require a student to have a 
cumulative GPA of 2.0 on a 4.0 scale 
(a “C” average) to graduate. The 
GPA standard applied during the 
years before graduation is often 
much less than 2.0, however. While 
allowing a low interim GPA require- 
ment is not wrong in itself, it can 
lead to a situation where the student 
stays in school on Federal aid for 
years without making satisfactory 
progress toward graduation. 

As an example, a community 
college visited had no GPA require- 
ment for the first 30 semester hours 
attempted, which means a student 
could attend full time for a year and 
a half before being subjected to the 
standard. The minimum GPA applied 
was a 1.5, which never changed as 
long as the student remained in 
school. A student could not gradu- 
ate, however, until his or her GPA 
reached a 2.0. Under this standard, a 
student could theoretically receive 
aid for years without achieving the 
grades necessary to graduate. 


In total, GPAs for students receiv- 
ing ED and SSA aid were lower than 
those receiving VA benefits. Nearly 
20 percent of ED aid recipients and 
23 percent of SSA aid recipients in 
the GAO samples had cumulative 
GPAs of less than a 2.0; only 12.4 per- 
cent of VA aid recipients had cumu- 
lative GPAs of less than 2.0. Even 
worse, 9.5 percent of ED aid recipi- 
ents and 10.8 percent of SSA aid 
recipients had less than a 1.5 GPA; 
only 3.5 percent of the VA aid recipi- 
ents had GPAs at that level. 

Another factor greatly influencing 
the measurement of academic prog- 
ress is the treatment of nonpunitive 
grades given for withdrawals, courses 
not completed, and courses repeated. 
Possibly the most common of these 
is withdrawals. While allowing stu- 
dents to withdraw from courses 
without penalty of a failing grade is 
an acceptable practice in itself, a 
policy which is too lenient can artifi- 
cially inflate a student’s GPA and 
distort the measurement of real 
progress. Such was the case at one 
school where a student with a cum- 
ulative GPA of 2.3 had actually com- 
pleted only 20 of 47 credit hours 
attempted, while receiving $5,400 in 
ED aid. A student at another school 
had maintained a GPA near a 2.0 
over eight semesters by withdrawing 
from 57 of 115 hours attempted, 
receiving more than $6,900 in ED aid 
during this period. School policies 
on withdrawals were often quite per- 
missive, sometimes allowing a stu- 
dent to withdraw without penalty up 
to two-thirds of the way through a 
term. One school had even let stu- 
dents withdraw after they had taken 
the final examination. 


Students who have not met all the 
requirements of a course by the end 
of a term are typically assigned a 
grade of “incomplete,” with the 
understanding a regular grade will 
be awarded when the requirements 
are met. Academic progress stan- 
dards are weakened by policies that 
are too permissive in awarding 
incomplete grades or do not require 
them to be cleared promptly. One 
college visited allowed students an 
entire year to clear incomplete 
grades and did not even strictly 
enforce this policy. Consequently, 
student GPAs were higher than they 
would have been if failing grades 
had been assigned. 
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Policies on grades for repeated 
courses vary greatly among schools. 
In computing the GPA, some schools 
include all the grades achieved, 
others only the highest grade, and 
still others only the last grade. A 
policy which fails to include all the 
grades received or allows students 
to repeat courses a number of times 
raises questions about the ability to 
measure progress. One student who 
had received more than $8,400 in ED 
aid had attempted the same speech 
course eight times and the same 
sociology course five times without 
passing either. A student at another 
school had taken accounting prin- 
ciples five times, earning three F’s 
and two D’s. 

Sometimes the problem with 
nonpunitive grades is the sheer num- 
ber awarded. One school awarded 
15 different letter grades of which 
only 5 affected a student’s GPA. 
During one term, nonpunitive grades 
accounted for almost half of the 
grades awarded by the school. 

Another factor greatly influencing 
academic progress is a student’s 
rate of progress toward his or her 
educational goal. At the schools 
GAO visited, the standards often 
included no quantitative measure of 
progress. Less than half of the stu- 
dents receiving aid were progressing 
at a rate to graduate within 4 years. 
Some students were several terms 
behind. 

Nothing is wrong with allowing 
students extra time to complete pro- 
grams unless this becomes the 
norm. The minimum requirement for 
a student receiving a Pell Grant for 
VA assistance is 12 credit hours per 
term. By continually enrolling for 
the minimum number of hours, 
many students otherwise making 
progress move toward program 
completion at a slow rate. This 
could be a potentially serious prob- 
lem in the Pell Grant program, which 
no longer places limitations on the 
number of years a student may 
receive aid. 

In addition to inadequate stan- 
dards, we found that some schools 
did not even enforce the standards 
they had implemented. Five schools 
had consistently failed to enforce 
standards for ED programs, leading 
to overpayments of about $1.28 mil- 
lion. Three other schools had not 
enforced their standards on ED stu- 
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dents in a limited number of cases. 
We also found that four schools 
were not adequately enforcing stan- 
dards for VA recipients; however, we 
were unable to determine the level 
of overpayments because VA bene- 
fits go directly to the student rather 
than through the school. 


What Can Be Done? 


While our findings could not be 
projected nationwide, setting ade- 
quate standards of academic prog- 
ress was clearly a problem. But 
what can be done? How can the 
Government ensure that schools 
establish adequate standards for 
students receiving aid without 
infringing on the schools’ rights to 
establish academic requirements 
consistent with their own goals? 

One answer to the problem is to 
encourage the institutions them- 
selves to develop effective self- 
regulatory standards. To this end, 
the American Council on Education 
published a policy statement in 
December 1981 outlining general 
guidelines for academic progress 
proposed by the American Associa- 
tion of Collegiate Registrars and 
Admissions Officers and the National 
Association of Student Financial 
Aid Administrators. This statement 
urged schools to establish and pub- 
lish effective standards for academic 
progress that are consistent with 
each school’s academic objectives 
and own diversity of students. School 
standards should set a reasonable 
length of time for a student receiv- 
ing aid to complete a program; pro- 
vide a statement on the effects of 
course incompletion, course with- 
drawal, course repetition, and non- 
credit remedial courses; include 
procedures for the appeal and rein- 
statement of aid lost; and ensure 
that an evaluation of aid eligibility is 
made at established intervals, at 
least once a year. 

While GAO agreed that improved 
self-regulation is an effective way to 
attack the problem, we also believed 
there was still a need for better cri- 
teria at the Federal level. There is 
really no good reason for three Fed- 
eral agencies having policies so dif- 
ferent. A need exists for a more 
nearly uniform set of guidelines that 
can be applied to all forms of assis- 
tance. These guidelines should con- 
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tinue to permit schools flexibility in 
establishing academic progress 
standards, but they should also set 
certain parameters within which 
such standards should fall. 

This recommendation was the 
basic thrust of our report, “Students 
Receiving Federal Aid Are Not Mak- 
ing Satisfactory Academic Progress: 
Tougher Standards Are Needed” 
(HRD-82-15), issued in December 
1981. In May 1982, the Secretary of 
Education proposed new regulations 
for academic progress under ED 
student financial assistance pro- 
grams, drawing from recommenda- 
tions included in the GAO report, 
the policy statement by the American 
Council on Education, and a quality 
control study on Pell Grants con- 
tracted by ED. The new regulations 
continue to permit schools to set 
their own standards of progress. 
However, these standards must 
adhere to policies generally accepted 
by the postsecondary education 
community as a whole. 

Under the proposed regulations, a 
school must conform with the stan- 
dards of academic progress estab- 
lished by an institution’s nationally 
recognized accrediting agency. If no 
such agency standards exist, or if 
an institution is not accredited, the 
institution must incorporate the ele- 
ments of a standard developed by 
the postsecondary education com- 
munity. These elements are grades, 
work projects completed or other 
factors measurable against a norm, 
and a timeframe for program com- 
pletion. Also, a standard must be 
consistently applied and must 
define the impact of incompletes, 
withdrawals, course repeats, and 
noncredit courses. Finally, there 
must be provision for appeal and 
reinstitution of aid upon correction 
of academic progress deficiencies. 

In August 1982, Senators Claiborne 
Pell of Rhode Island and Donald 
Nickles of Oklahoma introduced a 
bill (S. 2822) to amend the Higher 
Education Act, requiring minimum 
levels of progress that must be 
achieved by students receiving ED 
financial assistance. This amend- 
ment goes even further than the 
GAO recommendations by actually 
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Monday 


“It’s raining.” 

| was finishing my warm-up exer- 
cises when my wife Rae Ann pro- 
vided this weather report. We won’t 
do any running this morning. The 
traffic on 1-95 was slow and heavy, a 
usual condition when it rains. 

Upon arriving at work, my first 
order of business was to summarize 
the observation | made at last Fri- 
day’s entrance conference with the 
Navy project office. | am the evalua- 
tor in charge of a survey assessing 
the Navy’s development and pro- 
curement of the Trident Il submarine- 
launched ballistic missile system. 
Although | have worked on various 
Department of Defense weapon sys- 
tem assignments over the past 
6 years, this is my first major effort 
involving a strategic system. The 
Trident Il missile is a high-visibility 
program in the Congress and has an 
estimated $8 billion cost for system 
research and development. 

Later in the morning, | met with 
Mark Wielgoszynski, who works 
with me on this assignment, and 
David Brinkman, the assignment 
manager, to discuss last Friday’s 
entrance conference. We agreed the 
meeting was very effective in pre- 
senting survey objectives, assign- 
ment timeframes, organizations to 
be contacted, and the various Tri- 
dent Il program aspects to receive 
specific attention. The Navy repre- 
sentatives raised only a few ques- 
tions, and we scheduled a number 
of follow-on interviews with key pro- 
gram officials. During this morning’s 
discussion, we decided to begin 
finalizing the survey guidelines. 

| returned to my office and received 


a call from GAO’s liaison officer in 
the Office of the Secretary of Defense. 
After reviewing the letter which 
announced GAO’s audit, the liaison 
questioned how our survey differs 
from an assignment the Boston 
regional office staff is doing on the 
Trident submarine program. Having 
coordinated with Boston, | explained 
that my focus was primarily on the 
development and procurement of 
the missile system rather than on 
the submarine itself. My group’s 
involvement with the submarine pro- 
gram is only to the extent that the 
missile system affects submarine 
cost, schedule, and future force 
levels. The liaison officer was satis- 
fied with my explanation. 

| checked my calendar and noted 
a reminder to follow up and confirm 
my attendance at an upcoming 
nuclear weapons orientation course. 
| called an administrative aide at the 
Federal Emergency Management 
Agency to verify their receipt of the 
paperwork and found they had not 
received my security clearance 
information which had been mailed 
out weeks earlier. | skipped lunch to 
prepare and deliver the information 
to their security office. 

When | returned, | had a message 
to call our primary point of contact 
at the Trident II project office. Upon 
calling, | was asked if a briefing can 
be rescheduled for this Wednesday 
morning. | know Mark will not be 
available, but | agreed to the change 
since the information will be valuable 
in preparing the survey audit program. 

Mark was due for a performance 
evaluation this week, so | spent 
most of this afternoon completing 
it. Late in the day, | received a call 
from Andrea Kole in the Office of 
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General Counsel. Andrea and | are 
on the same GS-13/14 Management 
and Policy Advisory Council study 
group. The Council held its quarterly 
meeting last week in Washington, 
and our group was assigned the 
office’s Front-End Goal Test. Andrea 
called to see if | could attend a 
meeting later this week. Dick Fogel, 
director of the Office of Program 
Planning, wants to discuss how the 
Council can get involved with the 
test. | didn’t have any conflicts, and 
Andrea said she would get back 
with me. 

| finished the performance evalua- 
tion and stopped by David Brinkman’s 
office to drop it off. We discussed 
the evaluation and some issues 
involving our Ongoing assignment 
until it was time to catch my vanpool. 


Tuesday 


At the top of my “to do” list is 
reviewing the Trident Il survey work- 
papers and firming up the audit pro- 
gram. This involves a considerable 
amount of reading, analysis, and 
planning. Although not very exciting, 
it’s an essential part of assignment 
management. 

While | was going through the 
workpapers, Bernie Easton, the stra- 
tegic systems group director, came 
by. He wants me to give additional 
details on the assignment to an offi- 
cial who called this morning from 
the Office of the Secretary of Defense. 
| called and scheduled a meeting 
tomorrow afternoon at the Pentagon. 

| went by David Brinkman’s office 
to see if he wanted to discuss Mark’s 
evaluation. Everything was in order, 
and we got together with Mark for a 
counseling session. 

Back in my office, | got a surprise 
visit from John Alexander of our 
Huntsville staff. John and | worked 
together on a previous assignment, 
and we reminisced for a while. Our 
MASAD subdivision has always 
gotten good support from Huntsville, 
and John is an example of the quality 
of their staff. 

After lunch, | stopped by Bernie 
Easton’s office to brief him on the 
Trident Il assignment status. On my 
way out, | ran into Bob Parker, our 
divisional contact in the Office of 
General Counsel. Although lately | 
have not encountered any problems 
with gaining access to agencies’ 
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records, it’s an ongoing concern in 
defense assignments. | asked Bob if 
he would refresh my memory on 
GAO’s access rights and legal pro- 
cedures. A few other interested 
people asked if they could sit in on 
the discussion. Bob went through 
an informal summary of our access 
rights, past access problems, and 
the procedure used to resolve those 
problems. He made it clear that he is 
anxious to help if there is a problem. 
Getting back to my original project 
of the day, | continued going over the 
workpapers. | prepared a list of ques- 
tions for tomorrow morning’s meeting 
with the project office and finished 
a portion of the audit program. 
After work, | attended the first 
session of a stop-smoking program 
in which I’m enrolled. My New Year’s 
resolution finally caught up with me. 
| have needed this for quite a while 
and look forward eventually to out- 
running Rae Ann in a 6-mile race. 


Wednesday 


The first thing | did this morning 
was check to see if either David 
Brinkman or Bernie Easton could 
attend this morning’s meeting. Both 
were tied up, so | caught the subway 
to Crystal City, Virginia, where the 
project office is located. 

The project office takes up three 
floors of an office building and is a 
high-security area. Clark Gibbons, 
our Navy point of contact for this 
assignment, met me and checked 
me through the guard desk. Clark 
indicated that before | received the 
presentation on the project office’s 
organization and functions, one of 
the project directors wanted to dis- 
cuss a request for documents | 
made during the entrance confer- 
ence. | tend to be a pessimist prior 
to these types of discussions be- 
cause | am always aware of potential 
problems with access to records. 
I’m glad | talked to Bob Parker about 
this matter yesterday. However, the 
project director was very reasonable. 
He asked me to get some of the docu- 
ments from the Office of the Secretary 
of Defense since that organization 
prepared the information. | can take 
this up with the appropriate officials 
during my meeting at the Pentagon 
this afternoon. | concluded the dis- 
cussion by arranging for an on-site 
office for the GAO staff to use dur. 
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ing the Trident Il assignment. 

Next, | was escorted to another 
area where one of the branch heads 
had prepared a three-part slide pres- 
entation. | had a number of questions, 
and the first part of the presentation, 
normally running 20 minutes, took 
over 2 hours. Since it was getting late 
and | had an early afternoon meeting 
at the Pentagon, no one objected to 
scheduling a meeting Friday morning 
to finish the presentation. 

| caught the subway to the Penta- 
gon and had a quick lunch. Having a 
few minutes before the meeting, | 
stopped to see our Navy liaison, 
Aaron Cohen. Aaron said he received 
some positive feedback from the 
Trident II missile project office con- 
cerning our entrance conference. 
We briefly discussed the assign- 
ment status, and | had to rush to 
make my meeting. 

| arrived at Captain MacClary’s 
office, and we exchanged a few 
pleasantries. After | briefly described 
GAO's assignment objectives, time- 
frames, and areas of interest, we 
discussed the overall program, and 
the captain recommended a number 
of additional contacts. | asked for 
copies of three program documents 
prepared by the Office of the Secre- 
tary of Defense, and we ended our 
meeting by arranging to meet again 
Friday afternoon. 

Back to the subway. At the office, 
| found | had enough time to write up 
the day’s discussions. That’s good; | 
didn’t want to take work home this 
evening. Our new house came witha 
steep backyard, and tonight I’m going 
to make some plans for landscaping. 


Thursday 


Mark stopped by early this morning 
to discuss the meetings | had yes- 
terday. | gave him the documents | 
received and the corresponding 
writeups, and | made sure he would 
be available for tomorrow’s meet- 
ings. We also discussed moving to 
the project office for the remainder 
of the survey. Working on-site sup- 
ports our divisional philosophy that 
“there are no findings in the GAO 
building.” 

Next, | finished my travel order for 
next week’s training seminar. When | 
dropped it off for typing, | remem- 
bered | had not yet briefed Walt 
Sheley, MASAD’s director, on last 
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week’s GS-13/14 Council meeting. | 
stopped by Mr. Sheley’s office and 
made an appointment for early 
tomorrow morning. 
| checked my correspondence box 
and found Andrea Kole had called to 
tell me she couldn’t get the Council 
members coordinated for the meet- 
ing with Dick Fogel this week. There 
was also a note from Les Farrington, 
one of our group directors, asking if 
| would drop by his office after 
lunch. | then stopped by David Brink- 
man’s office to give him a summary 
of yesterday’s meetings. | spent the 
remainder of the morning working 
on the Trident II audit program. 
Returning from lunch, | ran into a 
coworker from our mission analysis 
subgroup who has some workpapers 
from a previous assignment which 
was related to the Trident II missile 
program. | arranged to use the work- 
papers during the Trident II survey. 
| dropped by Les Farrington’s 
office. Les is MASAD’s expert on 
Department of Defense matters 
related to evaluation. The Manage- 
ment College sponsors a 1-week 
course on test and evaluation in 
which Les and | present a segment on 
GAO’s view of the test and evaluation 
performed by the military services. 
The experience has been beneficial 
in establishing contacts within the 
test community and providing the 
military services with a better under- 
standing of GAO’s role and respon- 
sibilities. This afternoon Les wanted 
to discuss an upcoming course. We 
get together periodically and discuss 
parts of the presentation which may 
need to be updated or clarified. 
After meeting with Les, | got 
together with Mark to review the 
progress on the Trident II assignment 
and prepare for tomorrow’s meeting. 
| returned to my office and organized 


my GS-13/14 Council meeting notes 
for tomorrow’s appointment. 


Friday 


| arrived at work this morning a 
little early to prepare for my meeting 
with Mr. Sheley. Last week’s GS-13/14 
Council meeting began with remarks 
from Comptroller General Bowsher 
and ended with a number of Council 
projects being defined. These proj- 
ects will require a considerable 
amount of work before the next 
meeting. In my talk with Mr. Sheley, | 
highlighted the numerous speakers 
and presentations which received the 
Council’s attention. Mr. Sheley is very 
supportive of the Council and appre- 
ciated the report on our activities. 

| met Mark and we caught the 
subway to the project office in 
Crystal City. Today their security 
office had some trouble locating our 
clearance information. | made a 
mental note to request a temporary 
project office identification card for 
the remainder of the assignment. 
Clark Gibbons escorted us to the 
briefing room, and we resumed the 
presentation at part two. The pres- 
entation went into detail concerning 
project management and overall 
acquisition strategy. An interesting 
aspect of their organization is the 
existence of a Program Evaluation 
Branch. The branch provides the 
program manager with an indepen- 
dent assessment of virtually all 
aspects of the ongoing program. | 
had a good discussion with the 
branch manager over the role and 
reporting methods his office uses in 
relation to how GAO selects and 
performs assignments. Everything 
went smoothly, and we finished just 
before lunch. 

Mr. Gibbons found an office we 


could use, so we decided to spend 
the afternoon at the project office 
reviewing a number of documents 
identified during the morning’s 
presentation. 


Mr. Gibbons had the information 
available when Mark and | returned 
from lunch. The material provided a 
good overview of certain technical 
aspects of the program and gener- 
ated a number of discussion topics. 
| scheduled a meeting for later next 
week, requesting a briefing on the 
Trident Il development program 
status and the missile’s effect on 
the Trident submarine configuration. 


Before leaving Crystal City, | 
called Captain MacClary’s office 
and arranged to stop at the Pen- 
tagon to pick up some documents | 
had previously requested. Captain 
MacClary arrived a few minutes 
later, and we briefly discussed the 
Trident Il missile development 
status and various technical 
aspects of the missile’s configura- 
tion. The captain briefly summar- 
ized the documents he gave us, and 
we agreed to contact him if we 
needed any further clarification. 


After getting back to the GAO 
building, | logged in and read the 
documents we had picked up. | 
made some notes and prepared a 
list of follow-on questions to be pur- 
sued later. | then took a moment to 
reflect on this week’s events. All in 
all, the week had been hectic but 
productive. 

After work, Rae Ann and | met our 
MASAD coworker John Hutton and 
his wife Debbie for dinner at their 
favorite Irish restaurant in Old Town 
Alexandria. We wound down by talk- 
ing about the week’s activities but 
quickly made the transition into the 
weekend by listening to Irish music. 
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Legislative 
Developments 

















Federal Managers’ 
Financial Integrity 
Act of 1982 


Public Law 97-255, September 8, 
1982, 96 Stat. 814, the Federal Man- 
agers’ Financial Integrity Act of 
1982, amends the Accounting and 
Auditing Act of 1950 to require 
ongoing evaluations and reports on 
the adequacy of systems of internal 
accounting and administrative con- 
trol of each executive agency. 

Internal accounting and adminis- 
trative controls are to be established 
in accordance with standards pre- 
scribed by the Comptroller General. 

The Director of the Office of 
Management and Budget, in consul- 
tation with the Comptroller General, 
is to establish guidelines for the 
evaluation by agencies of their sys- 
tem of internal accounting and 
administrative control. 


Tax Equity and 
Fiscal Responsibility 
Act of 1982 


The Tax Equity and Fiscal Respon- 
sibility Act of 1982 (Public Law 97-248, 
September 3, 1982, 96 Stat. 324) con- 
tains several references to the work 
of the General Accounting Office. 

The Comptroller General is to 
monitor and evaluate a study and 
report by the Secretary of Health 
and Human Services on whether or 
not the reimbursement method and 
benefit structure (including copay- 
ment) for hospice care under title XVIII 
of the Social Security Act are fair 
and equitable and promote the most 
efficient provision of hospice care. 

Title V of the law, “Airport and 
Airway Improvement Act of 1982,” 
provides for airport development 
and airport planning by project 
grants. GAO is provided access to 
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records of grant recipients for pur- 
poses of audit. 

In cases where independent 
audits which may be required by the 
Secretary of Transportation are 
made, the grant recipients are to file 
a certified copy of the audit with the 
Comptroller General. 

On or before April 15 of each year, 
the Comptroller General is to report 
to Congress describing the results 
of each audit conducted or reviewed 
by him during the preceding fiscal 
year. 

Title VI, “Federal Supplemental 
Compensation Act of 1982,” provides 
for payment to States having agree- 
ments for the payment of Federal 
supplemental compensation. The 
Secretary of Treasury, prior to audit 
or settlement by GAO, is to make 
these payments to States in accord- 
ance with a certification by the 
Secretary of Labor. 

The Internal Revenue Code is 


amended with respect to disclosure 
of returns and return information for 
use in certain audits by GAO. The 
authority is expanded to include any 
returns or return information obtained 
by a Federal agency for use in any 


agency program or activity. GAO is 
permitted access to returns and 
return information that have not 
been obtained by the agency in cer- 
tain circumstances, provided that 
the agency is authorized to obtain 
the information for use in the pro- 
gram or activity that is the subject 
of the GAO audit. 


Net Worth 
Guarantee Act 


The Net Worth Guarantee Act, 
Public Law 97-320, October 15, 1982, 
contains a requirement for the 
Comptroller General to conduct an 


audit and report to Congress on a 
semiannual basis on the net worth 
certificate programs of the Federal 
Deposit Insurance Corporation and 
the Federal Home Loan Bank Board. 


Job Training 


The Job Training Partnership Act, 
Public Law 97-300, October 13, 1982, 
contains an amendment to the 
Wagner-Peyser Act requiring the 
Comptroller General to evaluate the 
expenditures by States of funds 
received in order to assure that 
expenditures are consistent with 
the provisions of the act and to 
determine the effectiveness of the 
State in accomplishing the purposes 
of the act. 


Military Medical 
Facilities 
Construction 


Legislation recommended by 
GAO to provide realistic sizing crite- 
ria for the construction of military 
medical facilities, taking into con- 
sideration retired personnel and 
their dependents, was enacted into 
law on October 15, 1982. (Public 
Law 97-337) 


Student Loan 
Marketing Association 


The conference report on S. 2852, 
Student Financial Assistance Tech- 
nical Amendments Act of 1982 
(H. Rept. No. 97-887) contains a 
request by the conferees that GAO 
conduct an extensive review of the 
Student Loan Marketing Associa- 
tion’s (SLMA) legislative authority 
and its program operations, as well 
as a more narrow interim study to be 
completed within 6 months. The 


conferees hope that these reports 
will advise them as to possible mod- 
ifications to the existing loan con- 
solidation authority of SLMA and the 
feasibility of extending such autho- 
rity to State guarantee agencies. 
The bill was enacted into law on 
October 13, 1982. (Public Law 97-301) 


Operational Testing 
and Evaluation 


Senator David Pryor of Arkansas 
introduced S. 3001, ‘Operational 
Testing and Evaluation Act of 1982,” 
to create within the Department of 
Defense an independent Office of 
Operational Testing. During his 
comments on the legislation, Sena- 
tor Pryor indicated he has ‘‘asked 
the General Accounting Office, the 
investigative arm of Congress, to 
conduct an intensive review of the 
Defense Department’s operational 
testing system. This request asks 
the GAO to look for weaknesses in 
the system and find out if test data 
compiled by the services gives us a 
valid and reliable indication of how 
weapons will perform in real-life 
situations.’" 


Debt Collection 


Referring to GAO studies describ- 
ing ‘‘the Federal Government’s poor 
performance in collecting overdue 
debts,”’ Senator Roger W. Jepsen of 
lowa introduced S. 3020, which 
establishes a Presidential Advisory 
Panel for Coordination of Govern- 
ment Debt Collection and Delin- 
quency Prevention Activities. He 
further states, ‘| am convinced that 
such a panel, composed of experts 
from the collection industry in the 
United States, will give the Govern- 
ment much needed advice in this 
area.’ 





‘Cong. Rec., Vol. 128 (Oct. 1, 
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Reflections 

















Since the Staff Bulletin stopped 
appearing in March 1960 and the 
GAO Review was not published until 
the winter of 1966, the following 
items were taken from the 1963 
spring issues of the Watchdog. 
Twenty years ago: 


e Joseph Campbell, Comptroller 
General of the United States, stressed 
“equal employment opportunity” by 
issuing, for the guidance of all GAO 
employees, a new Comptroller Gen- 
eral Order that was in accordance 
with the rules and regulations of the 
President’s Committee on Equal 
Employment Opportunity. 

The statement of policy, consistent 
with law, was based solely on merit 
and fitness; all supervisory employees 
and other employees authorized to 
initiate or effect specific personnel 
actions were directed, within the 
limits of the authority, to take appro- 
priate steps to ensure that there 
would be no discrimination because 
of race, color, creed, or national 
origin. It specified that all qualified 
persons would be afforded equal 
employment opportunity for employ- 
ment in the General Accounting 


Office and was to assure nondis- 
crimination in personnel matters, by 
policy and directives of the Presi- 
dent, as stated in Executive Order 
10925. Also, the regulations of the 
President’s Committee on Equal 
Employment Opportunity would be 
adhered to. 

e Comptroller General Elmer B. 
Staats established within GAO the 
Office of Energy and Special Projects 
due to the growing problems emerg- 
ing from shortages of energy re- 
sources. The new Office was under 
the direction of Assistant Comptroller 
General Phillip S. Hughes, formerly 
director of the GAO Office of Federal 
Elections. 

e James D. Martin, regional manager, 
Dallas, was honored by the Wash- 
ington Chapter, Federal Government 
Accountants Association, for his 
“outstanding performance evidenced 
in the work of the special GAO task 
force set up to make a comprehen- 
sive study of health facilities con- 
struction costs.” Mr. Martin was at 
that time an assistant director in the 
Manpower and Welfare Division. 
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e Edward A. Densmore, deputy 
director, HRD, was awarded the 
1973 William A. Jump Memorial 
Award for distinguished service in 
public administration. Mr. Densmore 
was then an assistant director in the 
Resources and Economic Develop- 
ment Division. 

e Baltas E. Birkle, deputy director 
of the Resources, Community and 
Economic Development Division, 
was designated an associate direc- 
tor in the Resources and Economic 
Development Division, responsible 
for audit assignments involving 


housing programs of the Department 
of Housing and Urban Development, 
effective September 17, 1972. 

e Brian P. Crowley, associate direc- 
tor, senior level, Resources, Com- 
munity and Economic Development 
Division, was designated an assis- 
tant director in the Resources and 
Economic Development Division, 
responsible for the audits of the air 
and water pollution control programs, 
effective October 29, 1972. 

e Seymour Efros, associate general 
counsel, was designated an assistant 
general counsel in the Office of Gen- 
eral Counsel, effective September 
1972. 

e Robert A. Peterson, senior asso- 


ciate director, Human Resources 
Division, was designated an assis- 
tant director in the General Govern- 
ment Division, with responsibility 
for the audits of seven independent 
regulatory agencies, effective Oc- 
tober 29, 1972. 

e Carmen E. Smarrelli, senior group 
director, Procurement, Logistics 
and Readiness Division, was desig- 
nated an assistant director in the 
Logistics and Communications Divi- 
sion, responsible for audits of logis- 
tics support services, such as indus- 
trial preparedness, Government 
printing, food services, public affairs, 
and industrial plant equipment, 
effective November 26, 1972. 
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Validity is an indicator of the ex- 
tent to which a process measures 
what it purports to measure. With re- 
spect to content analysis, validity 
refers to how well the coded infor- 
mation corresponds to reality. For 
example, how well does our count of 
insurance claims for stolen enter- 
tainment equipment correspond to 
the actual claims in the same sam- 
ple? (Errors due to sampling are a 
separate matter.) It is difficult to 
judge the validity of a content analy- 
sis because some other estimate of 
the number of claims needs to ex- 
ist—an estimate which can be used 
to gauge the correctness of the 
coding procedures. A variety of ap- 
proaches is available for determin- 
ing the validity. 

It should be noted, incidentally, 
that a measuring process may be 
high on reliability and yet low on 
validity; that is, there may be great 
consistency among the coders (high 
reliability), but they may make many 
common coding errors (low validity). 


Applications 


Whenever a need exists for nu- 
merical data and written messages 
from which we might extract 
such information, there is an 
opportunity to use content analysis. 
Whether any given opportunity 
would be a good application of the 
method depends upon several fac- 
tors, some of which are outside the 
realm of content analysis. No doubt 
there have been many ill-advised ap- 


plications of the data obtained from 
content analyses. We confine our 
comments to the coding process 
itself, not to analyses performed on 
the data. 

In most GAO applications, con- 
tent analysis would be one of 
several tools used to obtain 
answers to evaluative questions; 
that is, data produced by a content 
analysis would usually be combined 
with other information and then 
analyzed by standard techniques. 
For our purposes, written material is 
divided into two main categories: 
messages already available as a 
result of human transactions and 
messages that GAO elicited directly 
from respondents. Already available 
material includes legal documents, 
program descriptions, policy direc- 
tives, government reports, legisla- 
tion, transcripts of hearings, grant 
applications, etc. The distinguish- 
ing characteristic of this category is 
that the only act necessary to ac- 
quire the information we need is to 
ask for it. 

We obtain the other category of 
material when GAO seeks informa- 
tion directly from respondents 
through questionnaires or _ inter- 
views. Although some directly ac- 
quired information might already be 
in numerical form, other informa- 
tion, such as answers to open- 
ended questions, might usefully be 
coded by content analysis. Simi- 
larly, taped interviews and tran- 
scribed interview notes are can- 
didates for content analysis. The 
reason for distinguishing this 
category of material is that there is 


an opportunity, in the planning 
phase, to organize the information 
collection so as to minimize prob- 
lems during the content analysis 
phase. 


Where To Look For 
More Information 
About Content 
Analysis 


Babbie, E. R. The Practice of Social 
Research, Second Edition. 
Wadsworth, 1979. Includes a 
short, nontechnical introduction 
to content analysis, with ex- 
amples. 


General Accounting Office. Content 
Analysis: A Methodology for 
Structuring and Analyzing Written 
Material. Washington, D.C., 1982. 
Methodology Transfer Paper 3 
from the Institute for Program 
Evaluation. A brief, readable in- 
troduction to the topic. 


Holsti, O. R. Content Analysis for 
the Social Sciences and Human- 
ities. Addison-Wesley, 1969. Good 
coverage of operational details. 


Krippendorff, K. Content Analysis: 
An Introduction to Its Methodol- 
ogy. Sage, 1980. More difficult to 
read than the others, but useful, 
especially for its reliability and 
validity sections. 


North, R. C., et al. Content Analysis: 
A Handbook with Applications for 
the Study of International Crisis. 
Northwestern University Press, 
1963. Includes several variations 
on the content analysis theme. 
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LOOKING SOUTH, Cont. from p.20 
GAO Is on the Scene 


For followers of world affairs, it is 
clear that interest in Latin America 
and the Caribbean has never been 
greater and is on the increase. When 
you pick up tomorrow’s paper, you 
will read about developments in this 
region. It may involve a presidential 
or congressional visit, the Caribbean 
Basin Initiative, the Panama Canal, 
illegal immigration, or U.S. military 
assistance. But whatever the issue, 
rest assured that GAO has staff on 
the scene and is prepared to provide 
information and knowledgeable 
insights which can only be gained 
through firsthand experience. The 
LAB staff enjoy working in a region 
which is finally beginning to receive 
increased attention, and we also 
enjoy living in an environment that 
ID staff in Washington and the Euro- 
pean Branch can only dream about 
from November to March. 








DID you know that... 


e Panama has over 800 islands? 


Prospector? 


$89,154? 


in 1926 for $.36? 





AND you thought it was only a canal! 


e over 850 species of birds make Panama their home? 
¢ the name Panama is an Indian word meaning ‘abundance of fish?” 


e Panama’s Colon Free Zone is the largest free zone in the Western 
Hemisphere with $4.2 billion worth of goods passing through annually? 


e the 1983 Miss Universe contest will be held in Panama? 
Panama has over 130 international banks? 

e over 300 species of orchids flourish naturally in Panama? 

¢ Rod Carew and Roberto Duran are from Panama? 


e the longest vessel to transit the Canal was the 973-foot-long San Juan 


e the most expensive transit was by the Queen Elizabeth Il, which paid 


e the cheapest transit was by Richard Halliburton, who swam the canal 




















ROBOTICS, Cont. from p. 25 


the Federal Government will be 
involved in all aspects of the social 
problems created by automation. 
The controversial CETA program 
has raised many questions about 
Federal participation in training. 
Debate over the extent of this involve- 
ment will continue, but some roles 
filled by the Federal Government in 
the past should not be overlooked. 
They include the following: 

¢ Providing information. The gov- 
ernment is in the best position to 
collect and analyze work force infor- 
mation on a national scale. However, 
to date iittle effort has been devoted 
to providing information about the 
new technology, and recent budget 
cuts have impaired the reliability of 
data bases at the local level. 

e Promoting curriculum develop- 
ment. In the past, the Federal Gov- 
ernment has assisted in developing 
high-risk curricula to alleviate risks 
too great for individual institutions 
and prevent unnecessary duplication 
of effort. This type of Federal involve- 
ment is critical for vocational educa- 
tion.” Job displacement and techno- 
logical transformation are already 
occurring at a swift pace and will 
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accelerate in future years. Voca- 
tional institutions simply do not 
have time to waste resources and 
fail to explore critical new programs. 
e Promoting cooperation. The 
Government could also act as a cat- 
alyst in promoting cooperation 
between industry and educational 
institutions, as well as among the 
institutions themselves. Such coop- 
eration could alleviate problems, 
such as high equipment costs and 
teacher shortages. The Department 
of Education’s series of Robotics 
Roundtables is a step toward foster- 
ing this coordination. 

e Providing training assistance. 
Federal training funds have under- 
gone massive budgetary cuts during 
the past 2 fiscal years. Funds for 
retraining have been and will con- 
tinue to be relatively small. Yet 
allowing the burden to fall on the 
private sector may not provide ade- 
quate coverage. The responsibility 
for retraining workers when there 
are no jobs for them within the same 
company, or even the same industry, 
is unclear. However, the social costs 
to the Government of increased 
social welfare payments and ser- 
vices argue for Federal involvement. 
Programs such as the Downriver 


Community Conference may ensure 
worker protection while retaining 
local control. 

Programs to give the structurally 
unemployed useful skills will con- 
tinue to be important as more un- 
skilled jobs are eliminated. The 
recently enacted training legislation 
sponsored by Senators Quayle and 
Kennedy emphasizes this approach, 
but at funding levels far below those 
of the old CETA program. The ability 
of private-sector institutions to 
reach out to these people and absorb 
the Federal cuts is doubtful. Under 
CETA, vocational educational insti- 
tutions sometimes acted as pro- 
viders for Prime Sponsors. Private 
Industry Councils, a recent CETA 
addition emphasized by the new 
legislation, should try to improve 
their coordination with vocational 
educators.® 


Are We Prepared 
for Robotics? 


The mention of robotics evokes 
emotions ranging from optimism to 





7National Commission for Employment 
Policy, The Federal Role in Vocational 
Education, September 1981, pp. 11-13. 


*/bid., p. 67. 





ROBOTICS, Cont. from p. 53 


apprehension according to the per- 
ception of benefits received from 
the technology’s introduction. Auto- 
mation undoubtedly will cause 
structural hardship. The real ques- 
tions are how long this hardship will 


last for individual workers and 
whether the problems programmable 
automation creates will be greater 
than they need be. 

Failure to prepare for advanced 
technologies could lead to disaster, 
both for workers and the country’s 
industrial base. Yet early awareness 
of the technology’s implications 


could turn the potential for disaster 
into an opportunity for progress. For 
the vocational education system, 
anticipating the technology’s effects 
could mean an opportunity to pre- 
pare a highly skilled work force and 
to prevent the familiar paradox of 
skill shortages in the midst of 
unemployment. 





IMPROVEMENT, Cont. from p. 29 


deputy minister. This gives him a 
significant opportunity to assess 
progress toward meeting action 
plan goals at the individual manager 
level. 

The departmental officials with 
whom we met tended to support the 
OCG views about the importance of 
the cooperative relationship and the 
seed money provided to get projects 
started. One department had estab- 
lished a separate management ser- 
vices division to implement its action 
plan and help better organize the 
department’s operations. 

In summary, we were quite favor- 
ably impressed by the concepts 
underlying the IMPAC programs, the 
skills and attitudes of OCG person- 
nel responsible for carrying them 
out, and the progress described to 
us by department officials. We will 
benefit from their experience in 
developing guidelines for the original 
IMPAC surveys. Their thinking about 
what constitutes a good public man- 
agement system complements our 
own concepts and ideas. Finally, 
their faith in this change agent role 
and the departmental officials’ 
receptivity to the hands-on assistance 
provides valuable insights about how 
to achieve change constructively. 


Program Evaluation 
and Internal Audit 


While visiting the Comptroller 
General's office, we also met with 
officials responsible for overseeing 
program evaluation and _ internal 
audit activities in the executive 
departments. OCG establishes 
governmentwide policies on both 
these activities. 

With regard to program evaluation, 
departments and agencies are 
expected to regularly evaluate the 
efficiency and effectiveness of their 
programs as an integral part of pro- 
gram management. In the last 2 


54 


years, Canadian departments have 
been quite active in setting up pro- 
gram evaluation functions. Based 
on guidance provided by the OCG, 
they first established a departmental 
program evaluation policy to ensure 
that evaluations are conducted 
objectively, and then developed a 
departmental program evaluation 
plan delineating a set of program 
evaluation components and identi- 
fying when each component is to be 
evaluated. 

In theory, program evaluation 
should fit nicely into the PEMS sys- 
tem by providing program managers 
feedback to enable them to adjust 
and improve their long-range plans in 
light of actual results achieved. In 
reality, the progress to date has fallen 
short of expectations. Mr. Rogers 
reported in March 1982 that 


While progress is substantial, even 
impressive, | am unable to report 
that departments are now carrying 
out an adequate number of good 
quality evaluations or that the stud- 
ies conducted are uniformly and 
fully considered by departmental 
management. 


In providing guidance and assis- 
tance to the departments, OCG 
seemed to be taking a pragmatic 
approach. The official with whom 
we met commented on the uneven- 
ness across departments with which 
program evaluation was being 
implemented. Part of the problem 
was a shortage of qualified person- 
nel. Rather than prescribe a universal 
set of guidelines, OCG seemed to be 
supporting a concept that whatever 
was best in a given department’s 
environment is the way to go. 

Concerning internal audit, the 
OCG publishes governmentwide 
Standards akin to GAO’s yellow 
book. Canada’s internal auditors 
perform roles similar to those of our 
inspectors general but with some 


differences in emphasis and style. 
Auditors in Canada are seen more 
as an integral part of the manage- 
ment team. While they are still 
expected to retain their indepen- 
dence, greater emphasis has been 
placed on developing a constructive 
audit approach, whereby as much 
interest is shown in internal controls 
to eliminate waste and inefficiency 
as in those controls maintained for 
the prevention and detection of 
fraud. 

We learned about two facets 
unique to Canada. The first was the 
existence of a separate Audit Ser- 
vices Bureau in the Department of 
Supplies and Services. This bureau 
has 350 personnel who perform 
audits in such areas as federal/ 
provincial agreements and provide 
special audit services to smaller 
departments and agencies. This is 
similar to a core internal audit staff 
that picks up the overflow and 
handles miscellaneous chores. The 
second was the widespread use of 
management audit committees in 
the departments. 

The audit committees, chaired by 
the deputy minister and composed 
of senior department managers, 
help plan internal audit activities 
and assess managerial actions 
taken in response to internal audit 
reports. Through these committees, 
the internal auditors have a direct 
link to top management. In turn, top 
management has a voice in influ- 
encing the direction of internal audit 
activities. 

The OCG is encouraging depart- 
ments to include outside members— 
either from other departments or the 
private sector—on their audit com- 
mittees to improve objectivity and 
add external experience to the reso- 
lution of audit issues. So far, the 
departments have resisted this 
innovation. 


Overall, we viewed these audit 
committees as a promising initiative 
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that may improve communication 
between auditors and managers in 
our own government. On the other 
hand, we had no way of knowing 
whether internai auditors’ indepen- 
dence was infringed on by such 
committees. In addition, the statu- 
tory independence and reporting 
responsibility to the Congress may 
preciude the use of such commit- 
tees in our own executive depart- 
ments. Nevertheless, we are seeing 
greater cooperation between inspec- 
tors general through the President’s 
Council on Integrity and Efficiency 
and interaction with agency man- 
agers through joint OMB-sponsored 
meetings with the assistant secre- 
taries for administration. Perhaps 
instituting departmental manage- 
ment committees would be a logical 
extension of these other recent 
coordination efforts. With such 
committees, it would be harder for 
internal auditors to be ignored by 
top management. 


Bureau of 
Management 
Consulting 


Founded in 1946, the Bureau of 
Management Consulting offers a 
full spectrum of management con- 
sulting services to Canadian depart- 
ments and agencies on a fee-for- 
service basis. 

Although the consultants’ capabil- 
ities and skills are oriented to the 


public sector, they have previously 
amassed an impressive body of 
private-sector experience. They pro- 
vide specialized skills and tech- 
niques, solve problems peculiar to 
the public sector, and advocate new 
ideas and methods. Interdiscipli- 
nary teams of consultants can be 
assembled from other Canadian 
departments or the private sector 
working under subcontract. 

The consultants are well aware of 
Canadian government policy and 
procedures as well as underlying 
problems which might affect assess- 
ment of alternative courses of action. 
They claim to express their views in 
unequivocal fashion. To facilitate 
this, their reports are always confi- 
dential to the client. 

Bureau officials said they took 
pains to avoid competing with 
private-sector consultants. They do 
not undercut their prices. 

The Bureau was instrumental in 
helping to establish the Office of 
Comptroller General. They assisted 
in putting together the first survey 
package for the agency assess- 
ments. Now they are reaping the 
benefits. The Bureau is busier than 
ever as departments work toward 
implementing their action plans. 
Several new staff members had 
recently been brought on board at 
the time of our visit. 


Conclusions 


Reflecting on all our meetings 
and the information we brought back, 


here are some overall impressions: 
e The parliamentary system in 
Canada provides a different, perhaps 
better-suited framework for strategic 
planning and systematic manage- 
ment across government. 
e The Auditor General, as an agent 
of Parliament, will largely be looked 
on as an outsider, making the com- 
prehensive audit approach primarily 
an external force in management 
improvement. However, he has 
developed an approach worth con- 
sidering, and his staff has worked to 
develop criteria for assessing man- 
agement practices. 
¢ The IMPAC program is impressive 
but hard to emulate in the United 
States. OMB would be a better base 
for it than GAO if it were implemented 
here. Identifying cost savings is 
important in gaining cooperation 
and justifying continued support. At 
this point, it is hard to tell whether 
IMPAC will be a one-time effort or 
evolve into a continuous manage- 
ment improvement program. 
e Accomplishing our own manage- 
ment studies goals now seems 
more challenging than ever, but tak- 
ing the constructive approach advo- 
cated by the Canadian Comptroller 
General appears to be the most 
promising alternative even if we 
cannot emulate the IMPAC program 
in all its aspects. 

We will continue to follow devel- 
opments in Canada with great inter- 
est in the years ahead. 





WITNESSES, Cont. from p. 41 


ployee, and Government agencies 
seeking to recover unpaid criminal 
fines (Department of Justice) and 
taxes (Internal Revenue Service). 
Until April 1982, the Justice Depart- 
ment had a blanket policy to not dis- 
close a witness’ identity or location 
to help an innocent citizen enforce a 
court judgment against a witness. In 
effect, this previous policy precluded 
creditors and other persons from 
successfully collecting or enforcing 
lawful debts or judgments. Under its 
new policy, the Justice Department 
will now consider disclosing a wit- 
ness’ identity if it believes that the 
witness has adequate resources to 
satisfy a civil obligation and that the 
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disclosure will not result in harm to 
the witness. While this represents a 
major step in the resolution of civil 
problems, we believed legislative 
changes were needed to better bal- 
ance the competing interests the 
Department encounters in adminis- 
tering the program. 


GAO’s Efforts 


In our report on the administration 
of the Witness Security Program, we 
concluded that the resolution of 
civil problems caused by relocated 
witnesses creates a difficult dilemma 
for the Department of Justice. On 
one hand, the Department operates 
a program (believed to be indispen- 
sible in prosecuting high-level crimi- 
nals) that makes a commitment to 


protect the lives of witnesses in the 
program. Obviously, that protection 
is enhanced by keeping their new 
identities and locations a closely 
guarded secret. On the other hand, 
as the Nation’s chief law enforce- 
ment agency, the Department has a 
basic obligation to uphold the laws 
of the land and assist in their enforce- 
ment. When a creditor or other inno- 
cent citizen seeks to enforce a court 
order against a relocated witness, 
the Department must make a difficult 
choice between principles: It must 
choose either to disclose a witness’ 
identity to enforce law or not to dis- 
close to protect the witness and the 
program’s integrity. 

GAO is continuing its examination 
of the Witness Security Program for 
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the Chairman of the House Subcom- 
mittee on Courts, Civil Liberties and 
the Administration of Justice. This 
effort is the first independent exami- 


nation of the nature and extent of 
criminal activity by relocated wit- 
nesses. Also, we will be making the 
first comprehensive attempt to iden- 
tify and quantify program use and 


results. Through its efforts, GAO 
hopes to present information and 
recommendations that will help 
solve problems in the Witness 
Security Program. 





PROGRESS, Cont. from p. 45 


establishing minimum GPAs that 
the students must meet. Students 
would be required to have a “C” 
average at the end of each year they 
receive assistance. Students failing 
to achieve this would be placed on 
probation for one term, with suspen- 
sion of aid to follow if they still had 
not attained a “C” average at the 
end of that period. Exceptions 
would be granted only when the stu- 
dent could document an unusual 
hardship affecting his or her grades, 
such as a death in the family. A stu- 
dent could become eligible for 
assistance again by maintaining a 
“C” average for two consecutive 
grading periods, with permanent 


suspension of aid to follow if aid is 
lost a second time. The bill contain- 
ing this amendment has been referred 
to the Senate Committee on Labor 
and Human Resources. 


In Conclusion 


The problem of ensuring student 
academic progress will not be solved 
easily. The answers themselves are 
likely to present other thorny ques- 
tions. How do you deal with grade 
inflation? What happens when a 
school already struggling for survival 
is faced with having to set standards 
which may significantly reduce 
enrollment? How is progress to be 
measured at nontraditional schools 
which do not use a competitive 
grading system or which offer short- 


term programs? 


The unlikelihood of discovering a 
panacea for every possible aspect 
of the problem should not preclude 
attempts to deal with the problem 
itself. The final answer will no doubt 
require a number of actions and 
would hopefully be provided in part 
by the very parties for which the pro- 
grams are designed: the students 
themselves and the institutions they 
attend. The rewards are worth the 
struggle. Sound academic progress 
guidelines will not only ensure 
scarce resources are used efficiently 
but will also help to promote the 
integrity of these programs which 
have provided such a valuable bene- 
fit to Americans seeking a post- 
secondary education. 
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GAO Staff Changes 


Baltas E. Birkle 


Mr. Birkle has been named deputy 
director for operations in the Re- 
sources, Community and Economic 
Development Division. Within GAO, 
he has had widely diverse audit 
assignments, which included the 
Department of the Interior, Tennessee 
Valley Authority, U.S. Postal Service, 
NASA, GSA, VA, and HUD. In addi- 
tion, he served 2 years on the former 
Accounting and Auditing Policy 
Staff and 9 years as deputy director 
of the former Resources and Eco- 
nomic Development Division and 
the Community and Economic 
Development Division. 

Mr. Birkle attended the University 
of Maryland and received his B.S. in 
accounting in 1951. He also holds a 
master’s degree in economics. 

Mr. Birkle has attended the Pro- 
gram for Management Development 
at the Harvard Business School. He 
has received the GAO Career Devel- 
opment Award, the Distinguished 
Service Award, and the CED Director’s 
Award. Mr. Birkle is a CPA (Maryland) 
and a member of the American Insti- 
tute of CPAs and the District of 
Columbia Institute of CPAs. 
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Ralph Carlone 


Mr. Carlone has been named the 
deputy director for planning and 
reporting in the Resources, Commu- 
nity and Economic Development 
Division. 

A graduate of Bloomsburg State 
College in Pennsylvania, Mr. 
Carlone served in the U.S. Marine 
Corps (1956-60) and joined GAO in 
1964. His diverse assignments have 
included responsibilities for audits 
at the Veterans Administration and 
the former Atomic Energy Commis- 
sion. From 1976 to 1978, he served 
as associate director in the Energy 
and Minerals Division, responsible 
for the activities of the Nuclear 
Regulatory Commission and for 
audit and analysis of Department of 
Energy research and development 
programs. Since 1978, Mr. Carlone 
has served as regional manager of 
the Philadelphia office. 


yy) 
Mary Hamilton 


Mary Hamilton has been named 
assistant regional manager for oper- 
ations in the New York Regional 
Office. Ms. Hamilton was formerly 
the group director for science and 
technology in the Program Analysis 
Division. 

Ms. Hamilton joined GAO in 1979. 
Prior to 1979, she managed an energy 
policy group at the BDM Corpora- 
tion in McLean, Virginia, and taught 
sociology at St. Mary’s University in 
San Antonio, Texas. 

Ms. Hamilton holds a Ph.D. in 
sociology from the University of 
Maryland, an M.A. in sociology from 
the University of North Carolina, 
and a B.A. in sociology and psychol- 
ogy from Bethel College, St. Paul, 
Minnesota. 





GAO Staff Changes 


ATTRITIONS 
Division 

Accounting and Financial 
Management Division 


Personnel 


Program Analysis Division 


San Francisco 


Seattle 


Washington 


RETIREMENTS 


Marian Becker 
Phyllis Walker 


Name 


Kenneth George 
Christine E. Palmer 


Linda Boyer 


Marc Bickoff 
Henry Handy 
Thomas Woodward 


Lewis DeLeon 
Peter Fernandez 
Don Gilman 
Kathy Pareja 


Robert Smith 
Ralph Spencer 
Phil Sykora 


Judy Ashley 
Dona Sosnowski 


Cynthia Buckley 
Jeffrey Glick 
Donald Henry 


Linda Saunders 
Patricia Serone 


GAO Evaluator 
Personnel Clerk 


To 


ACTION 
American Speech-Language 
Association 


Dept. of the Interior 


Government Printing Office 
Private industry 
Congressional Research Service 


Dept. of the Army 

Dept. of the Interior 
Dept. of the Interior 
Colorado Dept. of Social 
Services 

Dept. of the Interior 
Dept. of the Interior 
Dept. of the Interior 


State of Washington 
Naval Postgraduate School 


Singing career 


Federal Emergency 
Management Agency 
Veterans Administration 
Not specified 
Honeywell, Inc. 


Detroit Regional Office 
Personnel 
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New Staff Members 





The following new staff members reported for work during the period September 6, 1982, and October 31, 1982. 


Office of Administrative and 
Publishing Services 


Office of the General Counsel 


Accounting and Financial 
Management Division 


Human Resources Division 


REGIONAL OFFICES 


Denver 


Seattle 


GAO Review/Spring 1983 


Wheeler, Katherine M. 


Ashen, David A. 
Chalpin, Mark G. 
Curcio, Mary G. 
Gaines, Joy E. 
Hynous, Anne M. 
Klazkin, Julian 
Leger, Charles P. 
Maguire, Frank 


Moorhouse, Richard L. 


Nagata, Joyce F. 
Smith, Stephen G. 


Mycka, Arleen M. 


Smith, Betty J. 
Vila, Maria L. 


Brenner, Sherry M. 
Gvoth, Paul A. 
Hixson, Sue E. 


Robinson, Beverly 


Dept. of the Army 


Hastings College of Law 
University of California 
St. John’s University 
University of Pennsylvania 
Wayne State University 
Catholic University 
Antioch School of Law 
Loyola Law School 
Suffolk University 
University of San Diego 
Villanova University 


MITRE Corp. 


Securities & Exchange Commission 
Bechtel International Construction 
Corp. 


Polly Chandler Bookstore 
University of Denver 
University of Cincinnati 


Robinson Newspaper 





Professional Activities 


Office of the 
Comptroller General 


Comptroller General Charles A. 
Bowsher addressed the following 
groups: 


President's Council on Integrity 
and Efficiency, Washington, Aug. 3. 


American Institute of Certified 
Public Accountants Annual Meet- 
ing, Portland, OR, Oct. 4. 


Canadian Comprehensive Auditing 
Foundation, Montreal, Oct. 5. 


Joint Meeting of the Association 
of Government Accountants, 
Central Germany Chapter, and 
the American Society of Military 
Comptrollers, Frankfurt, Heidel- 
berg, Rhineland-Pfalz Chapters, 
Frankfurt, Germany, Oct. 28. 


Office of the 
General Counsel 


Seymour Efros, associate general 
counsel: 


Spoke to the GSA Regional Coun- 
sel’s Conference on significant 
GAO procurement decisions on 
major procurement issues cur- 
rently confronting Federal agen- 
cies, Atlanta, Sept. 29. 


Jerold D. Cohen, senior attorney, 
participated in a panel discussion 
on architect-engineer contracts at 
the American Society of Civil Engi- 
neers Convention, New Orleans, 
Oct. 27-29. 


Richard Springer, senior attorney, 
participated in a seminar on “Man- 
aging an International Oil Supply 
Crisis,” sponsored by the American 
Bar Association, Annapolis, MD, 
Oct. 22-23. 


Personnel 


Donnie L. Dick, group manager of 
Personnel’s Operations Group, par- 
ticipated in a symposium on “Careers 
in Transition: A Public/Private Dia- 





logue for the Future,” sponsored by 
the Montgomery County Economic 
Advisory Council at the Linden Hill 
Hotel, Bethesda, MD, Oct. 25. 


Accounting and 
Financial Management 
Division 


George L. Egan, Jr., associate 
director: 


Participated in the President’s 
Council on Integrity and Efficiency 
Conference at the Office of Man- 
agement and Budget, Washington, 
Sept. 14. 


Together with Joseph D. Comtois, 
group director, spoke on “‘What’s 
Happening in Washington,” before 
the Mountain and Plains Intergov- 
ernmental Audit Forum, Cheyenne, 
WY, Oct. 22. 


Spoke on “Waste, Fraud, and 
Abuse,” before the Office of Per- 
sonnel Management’s Regional 
Management Conference, Atlanta, 
Oct. 26. 


Spoke on “Career Opportunities 
with the Federal Government,” 
before the American University’s 
Career Seminar on Accounting 
and Tax, Washington, Oct. 29. 


Brian L. Usilaner, associate direc- 
tor, spoke on “Cutback Management” 
at the Office of Personnel Manage- 
ment’s Management Conference, 
Atlanta, Oct. 26. 


Ronald J. Points, associate director: 


Spoke on internal controls before 
the Twelfth International Congress 
of Accountants, Mexico City, 
Oct. 12. 


Spoke on Single Governmental 
Audit Concepts before the North 
Carolina State CPA Meeting, 


Winston-Salem, NC, Oct. 25. 


W. A. Broadus, Jr., group director: 


Conducted briefings, workshops, 
etc., on Government Audit Stan- 
dards and governmental auditing 
at the Colorado Society of CPAs, 
1982 Governmental Conference, 
Denver, Sept. 10; Defense Audit 
Service, Washington, Sept. 21; 
Association of University and 
College Auditors, Annual Confer- 
ence, Pocono Manor, PA, Sept. 28; 
GAO Kansas City Regional Office, 
Kansas City, MO, Oct. 5-6; AICPA/ 
AGA National Governmental 
Training Program, Kansas City, MO, 
Oct. 20-21; AACSB Accounting 
Accreditation Visit to Indiana 
State University, Terre Haute, 
Oct. 24-27 (served as cochairman); 
and Indiana State Examiner’s 
Staff Meeting, Indianapolis, Oct. 27. 
Was appointed to serve on the 
AGA’s Financial Management 
Enhancement Board and to chair 
the relations with AICPA and 
NASBA Committee and to serve 
on the AACSB Special Task Force 
on Accounting Accreditation 
Standards. 


Joseph J. Donlon, senior group 
director, served as panel moderator 
for a seminar sponsored by the Joint 
Financial Management Improvement 
Program and the Capital Region of 
the Association of Government 
Accountants on the Prompt Payment 
Act, Arlington, VA, Sept. 13. 


Theodore F. Gonter, group director, 
chaired a session on “OMB Circu- 
lar A-123 and EDP Management” at 
the 18th annual meeting of the Com- 
puter Performance Evaluation Users 
Group, Washington, Oct. 28. 


James R. Watts, group director, 
spoke on “‘Computer-Related Fraud” 
before the Department of Agricul- 
ture’s Fourth Annual ADP Security 
Officers Seminar, Washington, 
Sept. 22. 


Carl R. Palmer, group director: 
Chaired a panel session on “De- 
fense Computer and Communica- 
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tions Acquisitions” at the Federal 
Computer Conference, Washing- 
ton, Sept. 29. 


Chaired a panel on “Financial 
Management” at the Computer 
Performance Evaluation Users 
Group annual meeting and spoke 
in the keynote session on ‘‘Chal- 
lenges for the Profession in the 
Eighties,” Washington, Oct. 25-26. 


Darrell Heim, ADP assignment 
manager: 


Together with Lee Conyers, man- 
agement analyst, spoke on “‘Audit- 
ing in a Computer Environment,” 
at the U.S. Army Logistic Manage- 
ment Center, Ft. Lee, VA, Sept. 20. 


Together with Roger McDonald, 
senior ADP auditor, discussed 
“Computers, Financial Audits, 
and Third Party Reviews,” at a 
training program sponsored by 
the Pennsylvania State Auditor 
General, Harrisburg, PA, Oct. 5. 


Lee Conyers, management ana- 
lyst, together with Ed Wingfield, 
ADP auditor, discussed ‘“‘Auditing in 
a Computer Environment,” at the 
U.S. Army Audit Agency’s East Cen- 
tral Region Staff Conference, Hamp- 
ton, VA, Oct. 27. 


Joint Financial 
Management 
Improvement 
Program 


Susumu Uyeda, executive director: 


Gave a presentation on JFMIP to 
USDA's Third Annual Financial 
Council Conference, Washington, 
Oct. 12. 


Spoke on “Internal Control and 
the Financial Integrity Act” at the 
Veterans Administration’s National 
Finance Officers meeting, Austin, 
TX, Oct. 26. 


Gave a talk to the Austin Chapter 
of the Association of Government 
Accountants on “Internal Control 
and the Financial Integrity Act,” 
Austin, TX, Oct. 26. 


Gave a presentation to the Houston 
Chapter of the Association of 
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Government Accountants on 
“Internal Control and the Financial 
Integrity Act,” Houston, TX, Oct. 26. 


General Government 
Division 


William J. Anderson, director, 
addressed the Brookings Institution’s 
Advanced Study Program Conference 
for Business Executives on Federal 
Government Operations, Washington, 
Sept. 27. 


Sebastian Correira, group director, 
discussed GAO’s report ‘‘Early 
Observations on Block Grant Imple- 
mentation” (GAO/GGD-82-79, Aug. 24, 
1982) before the Lutheran Resources 
Commission, Washington, Nov. 27. 


Richard B. Groskin, social science 
analyst: 


Was appointed cochairperson of 
the Policy Issues Committee of 
the American Society for Public 
Administration, Section on Crim- 
inal Justice Administration. 


Authored a resolution adopted by 
the National Council of ASPA in 
July 1982 calling upon the Presi- 
dent of the United States to estab- 
lish a National Commission on 
Crime Control and Administration 
of Justice Policy. 


Was appointed to a second term 
on the Executive Committee on 
National Policy for Justice Admin- 
istration of the American Society 
of Criminology for 1982-83. 


Human Resources 
Division 


John W. Lainhart, group director: 


Spoke at the Auditor General of 
Pennsylvania’s EDP Auditor 
Training Program on “Evaluating 
Internal Controls in Computer- 
Based Systems,” Harrisburg, VA, 
Sept. 14. 


Spoke at the Keystone Capital 
Area Chapter, EDP Auditors Asso- 
ciation meeting on “GAO’s Ap- 
proach to Evaluating Internal 
Controls in Computer-Based Sys- 
tems,” Lancaster, PA, Sept. 14. 


Samuel Deramo, evaluator, spoke 


Professional Activities 


on ‘“‘Medicare Home Health Program 
on Need, Use, and Cost,” before the 
Third Annual Conference on Aging 
and the Black Aged, at Morgan State 
University, Baltimore, Oct. 13. 


Institute for Program 
Evaluation 


Eleanor Chelimsky, director: 


Received the Evaluation Research 
Society’s Award for Evaluation in 
Government, at the ERS annual 
meeting, Baltimore, Oct. 28. 


Garry L. McDaniels, deputy direc- 
tor, coauthored a chapter with Mary 
Kennedy entitled “Informing Policy 
Makers About Programs for Handi- 
capped Children” in Learning From 
Experience: Evaluating Early Child- 
hood Demonstration Programs, pub- 
lished by the National Academy of 
Science, 1982. 


Wallace M. Cohen, group director: 


Chaired a session on “Evaluation 
and Accountability Issues” at the 
national meeting of the Operations 
Research Society of America and 
the Institute of Management 
Science, San Diego, in October. 
He was also a panelist in another 
session dealing with “Utilization 
of Evaluation Information by Fed- 
eral Managers.” 


Chaired the opening meeting of 
the Federal Agency Evaluation 
Director’s Forum at the Veterans 
Administration, Oct. 5. 


Together with Jeremiah Donoghue, 
site coordinator for the Albany 
regional suboffice, briefed mem- 
bers of the National Council of 
State Legislators, Executive Com- 
mittee on Program Evaluation, 
Albany, NY, Oct. 14-15. 


Ray Rist, deputy associate director, 
has had released by Sage Publica- 
tions his most recent book, Policy 
Studies Review Annual. This book 
has brought together 40 of the most 
important policy studies articles 
published between late 1980 and 
early 1982. 


Terry Hedrick, evaluator, was 
named the recipient of the Presi- 
dent’s Prize at the 1982 annual 
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Professional Activities 


meeting of the Evaluation Research 
Society in Baltimore, Oct. 28-30, 
1982. Ms. Hedrick received the 
award for execution of a GAO report 
entitled, “CETA Programs for Disad- 
vantaged Adults—What Do We 
Know About Their Enrollees, Ser- 
vices, and Effectiveness?”’ 


Program Analysis 
Division 


Osmund T. Fundingsland, asso- 
ciate director, served as resource 
person for the OPM/Washington 
Management Institute Program on 
Management of Scientific and Engi- 
neering Organizations and con- 
ducted sessions on ‘National 
Science and Technology Policies, 
Planning, and Organization” and 
“Management of R&D Programs 
and Projects,” Sept. 22. 


Mary Hamilton, group director, 
addressed the 50th anniversary 
meeting of the Accreditation Board 
for Engineering and Technology on 
“Federal Perspectives on Engineer- 
ing Education,” Colorado Springs, 
Oct. 27. 


Natwar M. Gandhi, supervisory 
evaluator, addressed the fourth 
annual University of Hartford Insti- 
tute on Insurance Taxation on “Is 
There Life After Stopgap? The GAO 
Perspective on Revision of the Life 
Insurance Company Income Tax Act 
of 1959,” Oct. 5. 


Robert Kershaw, evaluator, spoke 
on “The Use of Evaluability Assess- 
ment Principles To Support Con- 
gressional Budget and Oversight 
Reforms,” at the ERS/ENET Evalua- 
tion '82 meeting, Baltimore, Oct. 29. 


Charles Vehorn, economist, dis- 
cussed “Enterprise Pricing—User 
Fees and Charges” at the region IV 
conference of the American Society 
for Public Administration,” Pitts- 
burgh, Oct. 8. 


Regional Offices 


Chicago 


James P. Clark, evaluator, partici- 
pated in a panel discussion on 
“Employment of the Handicapped”’ 
before the Federal Executive Board, 


Chicago, Oct. 5. 
Stewart O. Seman, evaluator: 


In his role as regional vice president 
of the north central region of the 
Association of Government Ac- 
countants (AGA) spoke on “‘Devel- 
oping Professional Competence” 
before AGA’s Springfield, Illinois 
chapter, Oct. 20. 


Was appointed to the Chicago 
Federal Executive Board’s His- 
panic Employment Program man- 
ager’s awards subcommittee. 


Cincinnati 


Terry Davis, Bruce Fairbairn, 
Russell Keeler, Diana Brettl, evalua- 
tors, Cincinnati; and Bob Wychulis 
and Jeff Chaney, HRD, discussed 
GAO’s role in auditing the Social 
Security Disability Insurance Pro- 
gram and participated in a panel dis- 
cussion before the Indiana Chapter 
of the National Association of Dis- 
ability Examiners, Indianapolis, 
Oct. 27. 


Bob Kissel, evaluator, attended 
the 16th annual meeting of the Fed- 
eral Interagency Advisory Committee 
on Water Data, Virginia Beach, VA, 
Oct. 19-20. 


Jim Meissner, assistant regional 
manager: 


Spoke on ‘Fraud, Waste, and 
Abuse in Government Programs”’ 
before the Indianapolis AGA 
Chapter’s program on “Internal 
Controls in Government Activities,” 
Oct. 20. 


Spoke before the College of Mount 
St. Joseph’s professional devel- 
opment class on ‘Careers in the 
Government—An Emphasis on 
GAO,” Cincinnati, Oct. 28. 


Detroit 


Walter C. Herrmann, Jr., regional 
manager, spoke before the Associa- 
tion of Government Accountants, 
Lansing Chapter. His speech, entitled 
“The AGA: Where Are We Going?”’ 
was presented to the chapter in 
Lansing, MI, Sept. 23. 


Denver 


Emmanuel Olona, evaluator, 
received one of the greatest honors 


bestowed by the National Boy Scouts 
of America: induction into the Order 
of the Arrow, Camp Frank Rand, NM, 
Sept. 10-12. 


Robert W. Hanlon, 
manager: 


Participated with Shirley C. Ward, 
assistant regional manager, and 
Floyd A. Gonzales, evaluator, in 
the Hispanic Professional Career 
Opportunities Conference spon- 
sored by the League of United 
Latin American Citizens and the 
Digital Equipment Corporation. 
Also participating were Frank 
Campos, supervisory evaluator 
(San Francisco) and Richard C. 
Erbal, (Personnel), Denver, Oct. 30. 


regional 


Spoke on “Practice, Practice, 
Practice” before the charter meet- 
ing of the Hilltoppers Toastmis- 
tresses, Denver, Sept. 8. 


Together with James A. Reardon, 
senior evaluator, attended the 
semiannual meeting of the Moun- 
tains and Plains Intergovernmental 
Audit Forum, Cheyenne, WY, 
Oct. 21-22. 


James A. Reardon, senior evalu- 
ator, spoke on “Implementing the 
Single Audit” before the Federal 
Regional Council, Region VIII, 
Denver, Sept. 21. 


Norman G. Austen, evaluator, 
presented a symposium on “Auditing 
Computer-Based Systems” to repre- 
sentatives of the National Bureau of 
Standards, the Department of Com- 
merce, other Government agencies, 
and various commercial ADP vendors, 
Gaithersburg, MD, Sept. 29. 


Kansas City 


Gary Billen, professional develop- 
ment coordinator, spoke to the 
cooperative education students at 
Rockhurst College on the benefits 
of obtaining work experience in a 
co-op program and opportunities in 
GAO, Oct. 12. 


David A. Hanna, regional manager, 
discussed personnel system and 
organization changes with the per- 
sonnel administration class at the 
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University of Kansas, Lawrence, 
Oct. 28. 


Los Angeles 


Victor Ell, assistant regional 
manager, attended the Executive 
Development Program at the Univer- 
sity of California at Berkeley, Aug. 2-6. 


San Francisco 


Charlie Vincent, supervisory 
evaluator, talked to Navy meteorol- 
ogists at Alameda Naval Air Station 
about the role of GAO, Sept. 15. 


Art Davis, evaluator, taught an 
advanced cardiac life support class 
for medical personnel of the city 
and county of San Francisco on Oct. 
23. 


Seattle 
Donald A. Praast, senior evaluator: 


Spoke on “The Pacific Northwest 
Intergovernmental Audit Forum’s 
Program for Dealing with Sub- 
standard CPA Audit Work” at a 
conference of the Midwest Inter- 
governmental Audit Forum, Lan- 
sing, Ml, Oct. 6. 


Under the aegis of the Pacific 


Northwest Intergovernmental 
Audit Forum, coauthored “Audit- 
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ing for Fraud—A Resource Guide,” 
a comprehensive resource docu- 
ment for use by audit managers 
and field auditors on the subject 
of fraud and abuse, October. 


Charles D. Mosher, audit manager: 


As president of the Washington 
section (chapter) of the American 
Water Resources Association, led 
a leadership meeting of State sec- 
tion presidents at the 18th national 
association conference, San 
Francisco, Oct. 10. 


Keith C. Martensen, senior evalu- 


ator: 


Was appointed by the Director, 
Indian Health Service, Depart- 
ment of Health and Human Ser- 
vices, to the Director’s Task Force 
on Contract Health Services, 
Oct. 20. 


Served as a member of the Direc- 
tor’s Task Force at meetings of 
the Claims Processing Subcom- 
mittee, Billings, MT, Oct. 27-28, 
and Steering Committee, Wash- 
ington, Nov. 2. 


Walter R. Eichner, evaluator, spoke 
on ‘Fraud Auditing” at the Seattle 
Chapter, Association of Government 
Accountants’ annual Symposium on 
Financial Management, Oct. 28. 


Professional Activities 


Thomas E. Birmingham, evaluator: 


Was appointed as awards chair- 
person for 1982-83 by the Seattle 
Chapter, Association of Govern- 
ment Accountants, Sept. 15. 


Served as facilitator for a workshop 
on “Theory Z Management” at the 
Chapter’s annual Symposium on 
Financial Management, Seattle, 
Oct. 28-29. 


W. Floyd Nichols, senior evaluator, 
completed a 2-year term as treasurer 
and member of the board of trustees 
of the Seattle Philharmonic Orchestra. 


Washington 


Eric Marts, evaluator, together 
with Patricia Cole, evaluator, partici- 
pated in the U.S. Department of Edu- 
cation’s Office of Vocational and 
Adult Education’s Robotics Round 
Table Seminar, Washington, Aug. 19. 


Eileen Larence, evaluator: 


Is president-elect of the Northern 
Virginia Chapter of the American 
Society for Public Administration 
(ASPA). 


Was appointed to serve on the 
National Membership and Chapter 
Development Committee of ASPA. 








Annual Awards for Articles 
Published in The GAO Review 


Cash awards are presented each year for the best articles written by GAO 
staff members and published originally in The GAO Review. The awards are 
presented during the GAO Awards Program held annually in October in 
Washington. 

One award of $500 is available to contributing staff 35 years of age or 
younger at the date of publication, and another is available to staff over 35 
years of age at that date. Staff through grade GS-15 at the time they submit 
the article are eligible for these awards. 

The awards are based on recommendations of a panel of judges 
designated by the Editor. The judges will evaluate articles from the stand- 
point of their overall excellence, with particular concern for 
e originality of concept and ideas, 

degree of interest to readers, 

quality of written expression, 

evidence of individual effort expended, and 

relevance to “GAO’s mission.” 





Statement of Editorial Policy 


This publication is prepared primarily for use by the staff of the General 
Accounting Office (GAO) and outside readers interested in GAO’s work. 
Except where otherwise indicated, the articles and other submissions 
generally express the views of the authors and not an official position of the 
General Accounting Office. 

The GAO Review’s mission is threefold. First, it highlights GAO’s work 
from the perspectives of subject area and methodology. (The Review usually 
publishes articles on subjects generated from GAO audit work which are in- 
herently interesting or controversial. It also may select articles related to in- 
novative audit techniques.) Second and equally important, the Review pro- 
vides GAO staff with a creative outlet for professional enhancement. Third, it 
acts as historian for significant audit trends, GAO events, and staff activities. 

Potential authors and interested readers should refer to GAO Order 1551.1 
for details on Review policies, procedures, and formats. 





For sale by the Superintendent of Documents, U.S. Government Printing Office, 
Washington, D.C, 20410. 
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